-- Logs begin at Tue 2022-06-07 07:43:00 UTC, end at Tue 2022-06-07 09:03:44 UTC. -- Jun 07 08:28:56.539858 dv-cinder-740146-15-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 07 08:28:56.548156 dv-cinder-740146-15-iscsi devstack@n-api.service[103690]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 07 08:28:56.551705 dv-cinder-740146-15-iscsi devstack@n-api.service[103690]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 7 08:28:56 2022] *** Jun 07 08:28:56.551705 dv-cinder-740146-15-iscsi devstack@n-api.service[103690]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 07 08:28:56.551705 dv-cinder-740146-15-iscsi devstack@n-api.service[103690]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 07 08:28:56.551705 dv-cinder-740146-15-iscsi devstack@n-api.service[103690]: nodename: dv-cinder-740146-15-iscsi Jun 07 08:28:56.551705 dv-cinder-740146-15-iscsi devstack@n-api.service[103690]: machine: x86_64 Jun 07 08:28:56.551705 dv-cinder-740146-15-iscsi devstack@n-api.service[103690]: clock source: unix Jun 07 08:28:56.551705 dv-cinder-740146-15-iscsi devstack@n-api.service[103690]: pcre jit disabled Jun 07 08:28:56.551705 dv-cinder-740146-15-iscsi devstack@n-api.service[103690]: detected number of CPU cores: 4 Jun 07 08:28:56.551705 dv-cinder-740146-15-iscsi devstack@n-api.service[103690]: current working directory: / Jun 07 08:28:56.551705 dv-cinder-740146-15-iscsi devstack@n-api.service[103690]: detected binary path: /usr/bin/uwsgi-core Jun 07 08:28:56.551705 dv-cinder-740146-15-iscsi devstack@n-api.service[103690]: your processes number limit is 47680 Jun 07 08:28:56.551705 dv-cinder-740146-15-iscsi devstack@n-api.service[103690]: your memory page size is 4096 bytes Jun 07 08:28:56.551705 dv-cinder-740146-15-iscsi devstack@n-api.service[103690]: detected max file descriptor number: 2048 Jun 07 08:28:56.551705 dv-cinder-740146-15-iscsi devstack@n-api.service[103690]: lock engine: pthread robust mutexes Jun 07 08:28:56.551705 dv-cinder-740146-15-iscsi devstack@n-api.service[103690]: thunder lock: enabled Jun 07 08:28:56.551705 dv-cinder-740146-15-iscsi devstack@n-api.service[103690]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 07 08:28:56.551705 dv-cinder-740146-15-iscsi devstack@n-api.service[103690]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 07 08:28:56.595178 dv-cinder-740146-15-iscsi devstack@n-api.service[103690]: Python main interpreter initialized at 0x5560e610b9c0 Jun 07 08:28:56.595178 dv-cinder-740146-15-iscsi devstack@n-api.service[103690]: python threads support enabled Jun 07 08:28:56.595178 dv-cinder-740146-15-iscsi devstack@n-api.service[103690]: your server socket listen backlog is limited to 100 connections Jun 07 08:28:56.595178 dv-cinder-740146-15-iscsi devstack@n-api.service[103690]: your mercy for graceful operations on workers is 90 seconds Jun 07 08:28:56.595510 dv-cinder-740146-15-iscsi devstack@n-api.service[103690]: mapped 403077 bytes (393 KB) for 2 cores Jun 07 08:28:56.595585 dv-cinder-740146-15-iscsi devstack@n-api.service[103690]: *** Operational MODE: preforking *** Jun 07 08:28:56.595835 dv-cinder-740146-15-iscsi devstack@n-api.service[103690]: *** uWSGI is running in multiple interpreter mode *** Jun 07 08:28:56.595835 dv-cinder-740146-15-iscsi devstack@n-api.service[103690]: spawned uWSGI master process (pid: 103690) Jun 07 08:28:56.596021 dv-cinder-740146-15-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 07 08:28:56.596736 dv-cinder-740146-15-iscsi devstack@n-api.service[103690]: spawned uWSGI worker 1 (pid: 103691, cores: 1) Jun 07 08:28:56.596878 dv-cinder-740146-15-iscsi devstack@n-api.service[103690]: spawned uWSGI worker 2 (pid: 103692, cores: 1) Jun 07 08:28:56.596989 dv-cinder-740146-15-iscsi devstack@n-api.service[103690]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 07 08:28:57.810501 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 08:28:57.830519 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 08:28:58.522177 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 08:28:58.522177 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: from cryptography.utils import int_from_bytes Jun 07 08:28:58.522448 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 08:28:58.522448 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: from cryptography.utils import int_from_bytes Jun 07 08:28:58.522958 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 08:28:58.522958 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: from cryptography.utils import int_from_bytes Jun 07 08:28:58.523285 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 08:28:58.523285 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: from cryptography.utils import int_from_bytes Jun 07 08:29:01.129135 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 08:29:01.129824 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 08:29:01.129913 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 08:29:01.130252 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 08:29:01.130546 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 08:29:01.130859 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 08:29:01.131246 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.131246 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.131389 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 08:29:01.131549 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.131869 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.132132 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 08:29:01.132216 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.132489 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.132750 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 08:29:01.132863 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.133183 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.133284 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 08:29:01.133512 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.133773 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.133859 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.134091 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.134400 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.134482 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-740146-15-iscsi {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.134719 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.134994 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.135079 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.135320 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.135559 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.135641 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.135925 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.136161 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.136321 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.136762 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.136848 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.137034 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.137337 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.137501 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.137775 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.137920 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.138076 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.138408 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.138516 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.138723 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.138957 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.139051 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.139578 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.139675 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.139910 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.140180 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-740146-15-iscsi {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.140281 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.140529 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.140761 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.141065 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-740146-15-iscsi {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.141211 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.141465 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.141565 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.141875 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.142026 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.142193 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.142348 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.142610 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.142705 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.142922 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.143021 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.143236 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.143470 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.143568 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.143783 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.143881 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.144092 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.144187 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.144404 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.144497 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.144745 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.144839 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.145083 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.145184 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.145396 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.145500 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.145695 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.145788 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.146002 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.146100 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.146310 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.146409 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.146615 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.146709 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.146919 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.147017 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-740146-15-iscsi {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.147221 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.147315 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.147471 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.147602 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.147779 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.147915 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.148097 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.148321 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.148416 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.148629 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.148728 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.148936 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.149069 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.149231 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.149394 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.149551 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.149652 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.149870 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.149958 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.150178 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.150271 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.150486 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.150573 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.150792 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.150879 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.151100 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.151185 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.151397 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.151484 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.151699 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.151793 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.152002 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.152095 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.152306 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.152403 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.152603 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.152699 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.152902 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.153040 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.153173 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.153284 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.153481 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.153580 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.153794 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.153889 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.154110 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.154233 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.154446 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.154590 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.154680 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.154782 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.154941 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.155125 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.155257 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.155443 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.155572 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.155751 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.155877 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.156067 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.156181 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.156385 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.156481 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.156690 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.156788 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.157070 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.157172 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.157391 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.157487 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.157692 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.157784 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.157992 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.158085 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.158305 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.158400 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.158555 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.158648 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.158867 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.158958 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.159158 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.159254 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.159475 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.159570 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.159780 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.159874 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.160088 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.160182 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.160392 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.160488 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.160693 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.160779 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.161018 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.161120 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.161326 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.161413 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.161631 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.161725 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.161937 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.162037 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.162238 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.162341 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.162534 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.162633 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.162834 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.162919 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.163136 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.163221 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.163439 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.163604 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.163736 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.163823 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.163983 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.164083 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.164279 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.164380 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.164580 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.164666 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.164890 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.164976 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.165212 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.165312 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.165512 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.165605 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.165811 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.165897 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.166107 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.166207 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.166409 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.166505 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.166709 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.166802 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.167274 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.167381 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.167574 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.167671 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.167875 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.167961 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.168176 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.168271 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.168477 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.168563 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.168791 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.168877 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.169095 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.169185 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.169410 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.169497 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.169712 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.169805 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.170011 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.170094 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.170311 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.170404 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.171125 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.171225 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.171427 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.171514 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.171732 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.171815 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.172054 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.172152 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.172359 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.172462 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.172627 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.172712 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.172934 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.173075 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.173260 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.173375 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.173573 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.173687 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.173876 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.174001 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.174177 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.174291 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.174488 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.174602 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.174783 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.174914 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.175089 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.175203 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.175400 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.175521 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.175700 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.175822 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.176001 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.176114 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.176297 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.176429 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.176597 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.176722 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.176895 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.177058 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.177245 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.177348 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.177545 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.177633 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.177845 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.177942 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.178140 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.178235 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.178453 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.178541 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.178767 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.178860 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.179070 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.179159 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.179374 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.179463 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.179674 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.179760 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.179986 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:29:01.180072 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.180316 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.180409 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.180634 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.180725 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.180949 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.181071 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.181286 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.181379 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.181613 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.181701 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.181917 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.182029 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.182238 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.182369 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.182558 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.182679 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.182847 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.182970 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.183167 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.183283 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.183475 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.183590 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.183784 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.183909 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.184088 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.184201 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.184396 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.184507 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.184738 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.184955 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.185141 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.185267 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.185390 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.185521 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.185645 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.185780 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.185956 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.186083 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.186822 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.186955 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.187123 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.187260 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.187432 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.187569 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.187741 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.187870 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.188508 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.188602 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.188684 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.188775 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.188775 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.188935 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.189040 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.189122 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.189306 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.189393 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.189620 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.189717 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.189928 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.190016 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.190237 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.190373 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.190545 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.190647 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.190847 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.190932 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.191150 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.191235 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.191458 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.191555 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.191762 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.191848 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.192065 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.192152 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.192373 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.192468 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.192680 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.192779 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.192983 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.193169 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.193306 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.193395 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.193614 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.193700 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.193924 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.194015 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.194231 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.194318 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.194532 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.194625 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.194839 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.194933 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.195145 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.195238 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.195448 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.195541 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.195749 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.195843 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.196046 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.196132 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.196345 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.196431 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.196646 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.196741 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.196953 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.197068 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.197275 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.197362 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.197588 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.197681 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.197897 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.197982 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.198195 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.198280 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.198502 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.198589 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.198809 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.198894 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.199115 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.199202 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.199422 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.199511 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.199726 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.199812 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.200026 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.200113 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.200331 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.200435 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.200636 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.200725 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.200934 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.201075 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.201273 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.201368 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.201578 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.201664 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.201903 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.201999 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.202213 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.202305 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.202510 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.202596 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.202808 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.202903 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.203110 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.203195 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.203413 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.203499 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.203712 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.203810 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.204014 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.204099 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.204315 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.204409 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.204615 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.204711 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.204915 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.205025 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.205247 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.205344 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.205561 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.205648 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.205862 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.205947 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.206163 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.206263 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.206463 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.206551 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.206783 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.206881 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.207090 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.207174 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.207386 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.207479 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.207689 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.207774 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.207988 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.208073 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.208287 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.208374 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.208582 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.208668 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.208885 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.208981 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.209207 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.209303 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.209506 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.209591 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.209803 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.209899 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.210100 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.210196 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.210401 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.210537 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.210715 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.210833 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.211017 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.211125 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.211313 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.211411 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.211608 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.211714 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.211904 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.212008 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.212238 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.212336 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.212535 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.212632 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.212846 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.212982 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.213207 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.213293 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.213516 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.213605 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.213832 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.213927 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.214140 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.214235 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.214444 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.214531 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.214746 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.214830 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.215050 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.215135 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.215359 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.215453 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.215660 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.215745 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.215965 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.216056 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.216270 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.216357 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.216578 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.216663 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.216879 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.216977 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.217213 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.217299 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.217552 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.217653 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.217859 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.217953 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.218156 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.218241 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.218464 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.218548 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.218775 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.218870 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.219099 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.219185 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.219406 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.219492 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.219719 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.219819 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.220021 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.220108 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.220329 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.220415 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.220631 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.220784 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.220936 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.221052 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.221261 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.221354 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.221562 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.221658 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.221865 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.221951 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.222167 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.222259 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.222478 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.222572 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.222778 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.222863 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.223085 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.223187 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.223383 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.223477 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.223693 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.223782 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.223986 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.224079 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.224286 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.224370 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.224586 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.224679 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.224897 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.225024 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.225235 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.225323 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.225541 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.225627 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.225856 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.225951 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.226157 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.226244 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.226459 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.226546 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.226758 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.226852 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.227136 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.227277 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.227360 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.227437 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.227644 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.227740 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.227952 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.228036 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.228251 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.228336 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.228553 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.228640 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.228853 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.228941 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.229185 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.229275 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.229489 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.229577 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.229788 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.229875 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.230087 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.230174 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.230393 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.230480 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.230702 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.230786 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.231006 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.231109 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.231323 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.231427 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.231632 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.231717 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.231927 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.232022 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.232225 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.232313 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.232532 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.232617 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.232832 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.232927 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.233674 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.233770 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.233977 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.234071 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.234277 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.234373 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.234590 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.234674 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.234898 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.234984 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.235195 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.235291 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.235499 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.235585 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.235816 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.235902 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.236120 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.236389 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.236476 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.236722 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.236818 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.237046 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.237148 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.237363 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.237457 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.237673 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.237760 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.237976 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.238071 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.238284 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.238372 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.238590 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.238714 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.238896 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.238993 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.239200 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.239296 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.239514 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.239602 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.239817 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.239956 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.240116 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.240198 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.240411 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.240506 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.240709 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.240809 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.241045 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.241146 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.241330 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.241417 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.241637 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.241891 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.241987 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.242220 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.242307 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.242519 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.242604 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.242822 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.242916 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.243134 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.243221 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.243434 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.243520 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.243743 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.243833 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.244045 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.244144 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.244365 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.244461 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.244667 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.244765 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.244966 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.245116 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.245288 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.245374 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.245588 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.245691 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.245891 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.245976 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.246191 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.246290 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.246489 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.246577 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.246786 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.246880 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.247088 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.247174 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.247385 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.247473 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.247681 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.247776 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.247978 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.248063 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.248275 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.248363 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.248635 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.249263 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.249462 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.249550 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.249771 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.249860 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.250071 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.250167 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.250370 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.250465 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.250676 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.250761 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.250975 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.251065 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.251274 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.251373 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.251573 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.251658 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.251871 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.251958 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.252177 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.252276 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.252479 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.252571 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.252791 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.252876 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.253119 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.253222 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.253424 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.253510 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.253726 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.253811 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.254037 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.254133 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.254340 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.254481 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.254629 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.254715 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.254926 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.255015 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.255224 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.255308 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.255525 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.255612 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.255828 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.255915 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.256129 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.256215 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.256427 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.256511 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.256729 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.256815 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.257045 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.257135 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.257345 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.257443 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.257646 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.257731 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.257942 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.258036 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.258248 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.258342 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.258548 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.258633 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.258843 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.258928 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.259139 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.259234 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.259436 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.259521 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.259735 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.259833 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.260032 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.260132 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.260334 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.260432 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.260628 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.260714 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.260936 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.261043 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.261254 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.261349 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.261551 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.261637 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.261847 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.261942 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.262149 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.262234 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.262445 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.262529 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.262738 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.262825 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.263037 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.263121 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.263337 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.263423 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.263631 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.263725 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.263928 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.264017 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.264250 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.264349 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.264547 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.264633 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.264842 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.264928 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.265166 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.265267 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.265479 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.265565 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.265793 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.265879 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.266092 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.266256 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.266396 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.266483 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.266693 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.266780 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.266992 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.267087 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.267289 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.267376 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.267590 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.267691 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.267886 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.267983 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.268183 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.268275 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.268480 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.268566 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.268778 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.268872 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.269097 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.269198 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.269407 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.269531 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.269709 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.269797 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.270009 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.270094 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.270308 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.270407 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.270604 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.270692 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.270919 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.271011 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.271225 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.271354 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.271546 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.271640 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.271849 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.271942 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.272154 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.272249 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.272461 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.272546 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.272763 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.272856 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.273090 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.273191 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.273398 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.273492 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.273695 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.273780 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.274001 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.274096 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.274303 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.274388 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.274608 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.274694 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.274906 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.274993 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.275203 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.275290 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.275508 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.275593 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.275814 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.275909 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.276116 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.276208 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.276425 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.276511 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.276729 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.276816 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.277052 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.277142 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.277355 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.277443 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.277655 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.277742 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.277958 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.278042 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.278257 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.278354 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.278556 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.278678 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.278859 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.278985 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.279163 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.279293 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.279469 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.279595 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.279773 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.279930 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.280100 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.280240 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.280404 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.280552 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.280705 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.280863 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.281030 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.281199 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.281329 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.281615 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.281705 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.281929 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.282028 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.282230 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.282316 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.282528 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.282621 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.282830 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.282929 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.283128 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.283214 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.283433 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.283519 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.283730 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.283834 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.284039 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.284146 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.284343 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.284451 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.284645 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.284749 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.284963 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.285126 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.285287 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.285433 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.285605 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.285743 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.286017 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.286105 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.286327 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.286413 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.286629 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.286715 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.287036 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.287122 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.287344 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.287428 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.287648 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.287735 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.287951 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.288047 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.288250 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.288337 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.288550 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.288648 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.288853 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.288940 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.289191 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.289294 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.289490 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.289584 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.289790 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.289887 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.290087 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.290184 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.290400 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.290486 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.290699 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.290787 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.291006 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.291104 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.291329 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.291415 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.291650 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.291751 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.292205 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.292307 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.292533 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.292632 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.292926 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.293049 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.293254 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.293349 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.293571 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.293666 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.293888 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.293976 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.294205 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.294290 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.294505 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.294594 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.294809 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.294894 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.295110 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.295195 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.295412 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.296014 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.296249 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.296336 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.296556 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.296642 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.296866 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.296963 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.297198 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.297288 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.297518 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.297605 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.297834 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.297921 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.298137 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.298231 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.298441 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.298536 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.298759 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.298845 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.299063 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.299150 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.299385 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.299482 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.299698 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.299783 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.300019 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.300116 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.300331 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.300426 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.300634 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.300731 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.300940 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.301065 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.301273 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.301372 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.301573 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.301663 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.301874 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.301959 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.302178 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.302266 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.302483 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.302570 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.302791 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.302884 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.303097 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.303186 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.303399 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.303486 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.303699 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.303785 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.304016 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.304104 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.304315 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.304401 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.304630 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.304717 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.304941 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.305048 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.305280 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.305370 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.305596 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.305756 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.305898 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.305983 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.306200 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.306287 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.306509 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.306607 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.306808 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.306894 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.307107 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.307199 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.307405 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.307500 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.307709 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.307795 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.308009 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.308095 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.308309 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.308405 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.308611 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.308706 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.308930 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.309060 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.309258 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.309347 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.309577 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.309671 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.309883 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.309977 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.310186 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.310274 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.310494 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.310622 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.310794 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.310880 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.311137 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.311748 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.311927 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.312016 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.312267 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.312356 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.312569 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.312657 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.312870 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.312971 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.313193 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.313298 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.313498 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.313585 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.313796 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.313883 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.314096 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.314192 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.314397 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.314484 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.314713 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.314799 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.315013 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.315108 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.315329 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.315416 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.315631 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.315718 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.315932 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.316026 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.316236 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.316322 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.316531 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.316617 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.316846 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.316934 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.317184 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.317274 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.317511 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.317698 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.317825 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.318024 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.318142 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.318337 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.318464 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.318648 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.318769 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.318960 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.319088 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.319270 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.319433 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.319582 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.319709 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.319891 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.320018 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.320199 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.320328 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.320512 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.320637 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.320820 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.320948 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.321172 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.321280 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.321493 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.321582 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.321815 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.321902 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.322151 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.322247 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.322468 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.322564 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.322782 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.322973 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.323097 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.323295 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.323413 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.323603 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.323768 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.323909 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.324084 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.324215 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.324392 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.324524 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.324706 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.324817 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.325053 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.325158 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.325350 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.325445 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.325660 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.325754 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.325969 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.326057 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.326282 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.326370 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.326594 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.326681 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.326929 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.327025 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.327241 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.327348 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.327545 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.327637 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.327857 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.327945 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.328178 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.328264 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.328754 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.328865 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.328865 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.329039 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.329134 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.329215 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.329437 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.329534 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.329746 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.329832 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.330057 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.330260 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.330359 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.330579 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.330666 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.330912 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.331008 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.331233 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.331329 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.331541 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.331630 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.331845 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.331968 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.332149 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.332250 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.332459 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.332546 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.332763 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.332848 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.333089 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.333193 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.333400 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.333487 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.333707 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.333793 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.334008 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.334105 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.334316 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.334402 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.334626 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.334721 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.334927 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.335137 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.335246 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.335449 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.335536 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.335778 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.336066 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.336155 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.336409 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.336494 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.336720 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.336816 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.337060 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.337149 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.337390 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.337478 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.337686 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.337785 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.337985 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.338080 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.338290 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.338377 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.338591 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.338686 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.338888 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.338976 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.339198 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.339285 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.339501 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.339596 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.339802 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.339890 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.340102 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.340188 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.340407 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.340502 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.340717 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.340929 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.341038 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.341295 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.341398 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.341608 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.341695 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.341927 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.342054 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.342226 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.342341 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.342551 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.342646 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.342855 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.342941 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.343163 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.343259 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.343466 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.343551 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.343767 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.343852 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.344068 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.344157 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.344369 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.344457 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.344667 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.344760 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.344965 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.345134 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.345291 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.345377 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.345591 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.345679 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.345886 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.345973 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.346190 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.346276 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.346487 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.346573 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.346807 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.346901 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.347107 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.347194 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.347406 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.347502 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.347706 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.347793 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.348012 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.348098 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.348312 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.348407 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.348612 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.348706 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.348912 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.349025 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.349231 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.349333 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.349537 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.349624 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.349836 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.349922 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.350139 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.350380 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.350468 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.350718 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.350804 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.351014 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.351112 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.351317 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.351403 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.351661 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.351749 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.351966 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.352060 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.352263 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.352358 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.352562 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.352649 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.352872 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.352968 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.353201 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.353291 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.353507 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.353592 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.353812 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.353910 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.354118 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.354205 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.354424 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.354520 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.354732 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.354820 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.355038 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.355259 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.355354 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.355589 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.355686 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.355906 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.355992 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.356221 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.356306 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.356526 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.356622 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.356831 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.356964 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.357154 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.357241 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.357457 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.357547 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.357776 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.357863 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.358606 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.358703 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.358914 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.359001 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.359222 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.359307 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.359527 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.359612 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.359829 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.359917 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.360133 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.360225 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.360435 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.360520 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.360740 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.360828 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.361062 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.361155 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.361369 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.361474 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.361673 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.361768 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.361979 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.362068 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.362283 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.362388 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.362590 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.362677 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.362923 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.363009 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.363236 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.363336 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.363548 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.363635 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.363860 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.363946 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.364165 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.364260 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.364467 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.364557 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.364774 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.364901 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.365098 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.365204 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.365403 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.365498 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.365715 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.365802 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.366037 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.366128 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.366344 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.366431 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.366644 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.366742 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.366950 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.367072 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.367259 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.367361 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.367572 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.367687 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.367879 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.367986 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.368182 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.368283 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.368482 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.368590 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.368787 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.368891 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.369120 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.369221 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.369425 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.369524 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.369727 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.369824 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.370028 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.370125 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.370333 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.370431 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.370631 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.370734 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.370930 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.371018 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.371234 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.371322 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.371532 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.371632 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.371832 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.371928 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.372131 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.372219 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.372436 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.372530 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.372736 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.372831 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.373053 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.373144 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.373352 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.373437 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.374193 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.374301 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.374506 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.374595 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.374809 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.374894 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.375110 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.375209 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.375410 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.375504 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.375714 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.375801 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.376010 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.376106 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.376308 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.376402 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.376611 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.376697 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.376912 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.377104 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.377234 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.377333 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.377533 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.377619 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.377836 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.377924 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.378135 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.378221 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.378434 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.378522 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.378731 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.378820 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.379029 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.379116 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.379372 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.379466 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.379652 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.379748 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.379967 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.380060 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.380276 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.380370 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.380592 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.380678 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.380894 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.380989 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.381256 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.381403 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.381565 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.381652 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.381880 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.381966 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.382193 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.382288 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.382503 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.382597 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.382809 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.382895 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.383120 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.383210 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.383430 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.383517 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.383734 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.383829 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.384041 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.384128 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.384346 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.384445 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.384653 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.384747 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.384958 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.385086 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.385303 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.385389 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.385622 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.385720 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.385924 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.386011 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.386242 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.386334 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.386555 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.386653 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.386873 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.386959 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.387189 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.387306 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.387497 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.387609 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.387823 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.387921 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.388130 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.388227 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.388433 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.388541 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.388735 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.388831 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.388979 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 08:29:01.389099 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.389376 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.389689 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.390003 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.390326 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.390647 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.390956 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.391274 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.391596 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.391937 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.392249 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.392587 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.392912 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.393246 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.393555 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.393856 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:29:01.394097 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103691) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 08:29:01.448586 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO dbcounter [None req-23859023-8ad7-499a-944d-73f4db2ad570 None None] Registered counter for database nova_api Jun 07 08:29:01.452816 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO dbcounter [None req-98cb95c7-0e49-4e1d-ade3-711d65eb5eaa None None] Registered counter for database nova_api Jun 07 08:29:01.470671 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG oslo_db.sqlalchemy.engines [None req-23859023-8ad7-499a-944d-73f4db2ad570 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103692) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 08:29:01.472163 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG oslo_db.sqlalchemy.engines [None req-98cb95c7-0e49-4e1d-ade3-711d65eb5eaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103691) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 08:29:01.477275 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG dbcounter [-] [103692] Writer thread running {{(pid=103692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 08:29:01.478732 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG dbcounter [-] [103691] Writer thread running {{(pid=103691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 08:29:01.533293 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.context [None req-23859023-8ad7-499a-944d-73f4db2ad570 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),68d8339a-f93e-465c-95c1-304743b93326(cell1) {{(pid=103692) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 08:29:01.535007 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.context [None req-98cb95c7-0e49-4e1d-ade3-711d65eb5eaa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),68d8339a-f93e-465c-95c1-304743b93326(cell1) {{(pid=103691) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 08:29:01.537382 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-23859023-8ad7-499a-944d-73f4db2ad570 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:29:01.538929 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-23859023-8ad7-499a-944d-73f4db2ad570 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:29:01.539051 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG oslo_concurrency.lockutils [None req-98cb95c7-0e49-4e1d-ade3-711d65eb5eaa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103691) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:29:01.539698 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-23859023-8ad7-499a-944d-73f4db2ad570 None None] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:29:01.540585 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG oslo_concurrency.lockutils [None req-98cb95c7-0e49-4e1d-ade3-711d65eb5eaa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103691) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:29:01.541378 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG oslo_concurrency.lockutils [None req-98cb95c7-0e49-4e1d-ade3-711d65eb5eaa None None] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103691) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:29:01.541717 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-23859023-8ad7-499a-944d-73f4db2ad570 None None] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:29:01.543580 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG oslo_concurrency.lockutils [None req-98cb95c7-0e49-4e1d-ade3-711d65eb5eaa None None] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103691) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:29:01.543916 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO dbcounter [None req-23859023-8ad7-499a-944d-73f4db2ad570 None None] Registered counter for database nova_cell0 Jun 07 08:29:01.546177 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO dbcounter [None req-98cb95c7-0e49-4e1d-ade3-711d65eb5eaa None None] Registered counter for database nova_cell0 Jun 07 08:29:01.548442 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO dbcounter [None req-23859023-8ad7-499a-944d-73f4db2ad570 None None] Registered counter for database nova_cell1 Jun 07 08:29:01.550102 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO dbcounter [None req-98cb95c7-0e49-4e1d-ade3-711d65eb5eaa None None] Registered counter for database nova_cell1 Jun 07 08:29:01.555554 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG oslo_db.sqlalchemy.engines [None req-23859023-8ad7-499a-944d-73f4db2ad570 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103692) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 08:29:01.557718 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG oslo_db.sqlalchemy.engines [None req-23859023-8ad7-499a-944d-73f4db2ad570 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103692) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 08:29:01.559619 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG oslo_db.sqlalchemy.engines [None req-98cb95c7-0e49-4e1d-ade3-711d65eb5eaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103691) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 08:29:01.560784 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG oslo_db.sqlalchemy.engines [None req-98cb95c7-0e49-4e1d-ade3-711d65eb5eaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103691) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 08:29:01.562789 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG dbcounter [-] [103692] Writer thread running {{(pid=103692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 08:29:01.567886 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG dbcounter [-] [103691] Writer thread running {{(pid=103691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 08:29:01.569154 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG dbcounter [-] [103691] Writer thread running {{(pid=103691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 08:29:01.699201 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG dbcounter [-] [103692] Writer thread running {{(pid=103692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 08:29:01.709405 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO dbcounter [None req-23859023-8ad7-499a-944d-73f4db2ad570 None None] Registered counter for database nova_cell0 Jun 07 08:29:01.713418 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO dbcounter [None req-98cb95c7-0e49-4e1d-ade3-711d65eb5eaa None None] Registered counter for database nova_cell0 Jun 07 08:29:01.718183 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG oslo_db.sqlalchemy.engines [None req-23859023-8ad7-499a-944d-73f4db2ad570 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103692) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 08:29:01.721874 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG oslo_db.sqlalchemy.engines [None req-98cb95c7-0e49-4e1d-ade3-711d65eb5eaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103691) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 08:29:01.722508 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG dbcounter [-] [103692] Writer thread running {{(pid=103692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 08:29:01.726050 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG dbcounter [-] [103691] Writer thread running {{(pid=103691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 08:29:02.231199 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: WARNING keystonemiddleware.auth_token [None req-23859023-8ad7-499a-944d-73f4db2ad570 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 08:29:02.239336 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: WARNING keystonemiddleware.auth_token [None req-23859023-8ad7-499a-944d-73f4db2ad570 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 08:29:02.338263 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: WARNING keystonemiddleware.auth_token [None req-98cb95c7-0e49-4e1d-ade3-711d65eb5eaa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 08:29:02.346070 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: WARNING keystonemiddleware.auth_token [None req-98cb95c7-0e49-4e1d-ade3-711d65eb5eaa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 08:29:02.457323 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: WARNING keystonemiddleware.auth_token [None req-23859023-8ad7-499a-944d-73f4db2ad570 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 08:29:02.463143 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: WARNING keystonemiddleware.auth_token [None req-23859023-8ad7-499a-944d-73f4db2ad570 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 08:29:02.468784 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5560e610b9c0 pid: 103692 (default app) Jun 07 08:29:02.471865 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-23859023-8ad7-499a-944d-73f4db2ad570 None None] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:29:02.473055 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-23859023-8ad7-499a-944d-73f4db2ad570 None None] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002705 Jun 07 08:29:02.473463 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 788 bytes} [Tue Jun 7 08:29:02 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:29:02.566008 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: WARNING keystonemiddleware.auth_token [None req-98cb95c7-0e49-4e1d-ade3-711d65eb5eaa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 08:29:02.571971 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: WARNING keystonemiddleware.auth_token [None req-98cb95c7-0e49-4e1d-ade3-711d65eb5eaa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 08:29:02.577632 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5560e610b9c0 pid: 103691 (default app) Jun 07 08:30:23.226343 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-23859023-8ad7-499a-944d-73f4db2ad570 None None] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:30:23.227367 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-23859023-8ad7-499a-944d-73f4db2ad570 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jun 07 08:30:23.227757 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 2/2] 10.222.0.17 () {54 vars in 930 bytes} [Tue Jun 7 08:30:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:30:23.245875 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG dbcounter [-] [103691] Writing DB stats nova_api:SELECT=3 {{(pid=103691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:30:23.246817 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG dbcounter [-] [103691] Writing DB stats nova_cell0:SELECT=3 {{(pid=103691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:30:23.247805 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG dbcounter [-] [103691] Writing DB stats nova_cell1:SELECT=3 {{(pid=103691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:30:23.249011 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG dbcounter [-] [103691] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:30:23.669639 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-1eae5fad-e772-48d9-a38e-5c249420177f admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:30:23.699684 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-1eae5fad-e772-48d9-a38e-5c249420177f admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.462920 Jun 07 08:30:23.700852 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 1/3] 10.222.0.17 () {60 vars in 1291 bytes} [Tue Jun 7 08:30:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:30:25.992040 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-23859023-8ad7-499a-944d-73f4db2ad570 None None] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:30:25.993039 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-23859023-8ad7-499a-944d-73f4db2ad570 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Jun 07 08:30:25.993442 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 3/4] 10.222.0.17 () {54 vars in 930 bytes} [Tue Jun 7 08:30:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:30:26.051720 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-52875849-a79f-4c1c-8180-3272a07a399f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "disk": 1, "id": "c1", "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "cirros256"}} {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:30:26.070468 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 08:30:26.070468 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: warnings.warn(msg) Jun 07 08:30:26.133038 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-52875849-a79f-4c1c-8180-3272a07a399f admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.132817 Jun 07 08:30:26.133700 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 2/5] 10.222.0.17 () {64 vars in 1282 bytes} [Tue Jun 7 08:30:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 08:30:26.147388 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG dbcounter [-] [103692] Writing DB stats nova_api:SELECT=3 {{(pid=103692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:30:26.148759 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG dbcounter [-] [103692] Writing DB stats nova_cell1:SELECT=3 {{(pid=103692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:30:26.149698 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG dbcounter [-] [103692] Writing DB stats nova_cell0:SELECT=3 {{(pid=103692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:30:26.150605 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG dbcounter [-] [103692] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:30:26.356825 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-cc52a5bc-cce4-4d30-b004-5030a0903e3d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:30:26.359838 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 08:30:26.359838 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: warnings.warn(msg) Jun 07 08:30:26.468571 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-cc52a5bc-cce4-4d30-b004-5030a0903e3d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.326510 Jun 07 08:30:26.469185 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 4/6] 10.222.0.17 () {64 vars in 1335 bytes} [Tue Jun 7 08:30:26 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:30:28.753754 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-52875849-a79f-4c1c-8180-3272a07a399f admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:30:28.754796 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-52875849-a79f-4c1c-8180-3272a07a399f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 Jun 07 08:30:28.755430 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 3/7] 10.222.0.17 () {54 vars in 930 bytes} [Tue Jun 7 08:30:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:30:28.866954 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-d1a8f1cf-83d6-497f-a72c-b899f6516be5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "swap": 0, "name": "ds512M", "disk": 5, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:30:28.885215 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 08:30:28.885215 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: warnings.warn(msg) Jun 07 08:30:29.038977 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-d1a8f1cf-83d6-497f-a72c-b899f6516be5 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.276479 Jun 07 08:30:29.042540 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 5/8] 10.222.0.17 () {64 vars in 1282 bytes} [Tue Jun 7 08:30:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 08:30:29.052071 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-e250dc42-449c-4933-a2ce-3cfb94e7bf39 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:30:29.053586 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 08:30:29.053586 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: warnings.warn(msg) Jun 07 08:30:29.155347 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-e250dc42-449c-4933-a2ce-3cfb94e7bf39 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101049 Jun 07 08:30:29.158476 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 4/9] 10.222.0.17 () {64 vars in 1335 bytes} [Tue Jun 7 08:30:29 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:30:31.579017 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-d1a8f1cf-83d6-497f-a72c-b899f6516be5 admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:30:31.580026 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-d1a8f1cf-83d6-497f-a72c-b899f6516be5 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jun 07 08:30:31.581840 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 6/10] 10.222.0.17 () {54 vars in 930 bytes} [Tue Jun 7 08:30:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:30:31.651660 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-42608ec4-b604-4f50-a118-0829048b0c35 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "ram": 1024, "name": "ds1G"}} {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:30:31.738793 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-42608ec4-b604-4f50-a118-0829048b0c35 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.148762 Jun 07 08:30:31.754737 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 5/11] 10.222.0.17 () {64 vars in 1282 bytes} [Tue Jun 7 08:30:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 08:30:31.754931 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-5d364647-6e11-44e0-a9f2-bec12092467f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:30:31.864036 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-5d364647-6e11-44e0-a9f2-bec12092467f admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113913 Jun 07 08:30:31.869152 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 7/12] 10.222.0.17 () {64 vars in 1335 bytes} [Tue Jun 7 08:30:31 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:30:34.211477 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-42608ec4-b604-4f50-a118-0829048b0c35 admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:30:34.212411 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-42608ec4-b604-4f50-a118-0829048b0c35 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Jun 07 08:30:34.213032 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 6/13] 10.222.0.17 () {54 vars in 930 bytes} [Tue Jun 7 08:30:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:30:34.290713 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-2aa8ae53-3b84-48f6-9249-f2d5c840de8d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d3", "ram": 2048, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "name": "ds2G"}} {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:30:34.376109 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-2aa8ae53-3b84-48f6-9249-f2d5c840de8d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.156008 Jun 07 08:30:34.376898 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 8/14] 10.222.0.17 () {64 vars in 1282 bytes} [Tue Jun 7 08:30:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 08:30:34.389645 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-f4175dce-321e-4ac9-a5bb-26654a08a7fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:30:34.476455 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-f4175dce-321e-4ac9-a5bb-26654a08a7fe admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091299 Jun 07 08:30:34.476970 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 7/15] 10.222.0.17 () {64 vars in 1335 bytes} [Tue Jun 7 08:30:34 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:30:36.867732 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-2aa8ae53-3b84-48f6-9249-f2d5c840de8d admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:30:36.869646 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-2aa8ae53-3b84-48f6-9249-f2d5c840de8d admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002315 Jun 07 08:30:36.876091 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 9/16] 10.222.0.17 () {54 vars in 930 bytes} [Tue Jun 7 08:30:36 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:30:36.944054 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-9220b82f-10db-4f47-a0fa-df30761a059f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "d4"}} {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:30:37.022835 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-9220b82f-10db-4f47-a0fa-df30761a059f admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.146148 Jun 07 08:30:37.037762 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-477e3547-211b-4337-9441-ab642f5e70a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:30:37.043909 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 8/17] 10.222.0.17 () {64 vars in 1282 bytes} [Tue Jun 7 08:30:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 08:30:37.116591 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-477e3547-211b-4337-9441-ab642f5e70a6 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083377 Jun 07 08:30:37.118065 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 10/18] 10.222.0.17 () {64 vars in 1335 bytes} [Tue Jun 7 08:30:37 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:30:39.423332 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-9220b82f-10db-4f47-a0fa-df30761a059f admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:30:39.424528 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-9220b82f-10db-4f47-a0fa-df30761a059f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001704 Jun 07 08:30:39.425216 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 9/19] 10.222.0.17 () {54 vars in 930 bytes} [Tue Jun 7 08:30:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:30:39.485319 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-b89a35ff-06f2-480b-9a2b-ade4c36acf97 admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:30:39.509860 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-b89a35ff-06f2-480b-9a2b-ade4c36acf97 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078385 Jun 07 08:30:39.510543 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 11/20] 10.222.0.17 () {60 vars in 1291 bytes} [Tue Jun 7 08:30:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:30:41.835856 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-9220b82f-10db-4f47-a0fa-df30761a059f admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:30:41.836877 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-9220b82f-10db-4f47-a0fa-df30761a059f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jun 07 08:30:41.837325 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 10/21] 10.222.0.17 () {54 vars in 930 bytes} [Tue Jun 7 08:30:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:30:41.909582 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-db5b07ba-9ec1-46bb-850e-3bc10b86e288 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "1", "disk": 1, "ram": 512, "swap": 0, "name": "m1.tiny"}} {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:30:41.992255 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-db5b07ba-9ec1-46bb-850e-3bc10b86e288 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.148310 Jun 07 08:30:41.992861 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 12/22] 10.222.0.17 () {64 vars in 1282 bytes} [Tue Jun 7 08:30:41 2022] POST /compute/v2.1/flavors => generated 402 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 08:30:42.006144 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-874fa817-4b90-4078-9732-fd283f0526ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:30:42.095785 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-874fa817-4b90-4078-9732-fd283f0526ef admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094058 Jun 07 08:30:42.096597 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 11/23] 10.222.0.17 () {64 vars in 1332 bytes} [Tue Jun 7 08:30:42 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:30:44.387139 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-db5b07ba-9ec1-46bb-850e-3bc10b86e288 admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:30:44.388219 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-db5b07ba-9ec1-46bb-850e-3bc10b86e288 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Jun 07 08:30:44.388641 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 13/24] 10.222.0.17 () {54 vars in 930 bytes} [Tue Jun 7 08:30:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:30:44.460345 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-2ee9bc6f-1bf7-4ea2-9417-159fddd8c652 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "name": "m1.small", "ram": 2048}} {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:30:44.517923 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-2ee9bc6f-1bf7-4ea2-9417-159fddd8c652 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.123060 Jun 07 08:30:44.518486 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 12/25] 10.222.0.17 () {64 vars in 1282 bytes} [Tue Jun 7 08:30:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 08:30:44.530897 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-99a0288c-9eca-452c-bf2c-c375f3758a95 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:30:44.600898 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-99a0288c-9eca-452c-bf2c-c375f3758a95 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074210 Jun 07 08:30:44.601550 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 14/26] 10.222.0.17 () {64 vars in 1332 bytes} [Tue Jun 7 08:30:44 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:30:47.357502 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-2ee9bc6f-1bf7-4ea2-9417-159fddd8c652 admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:30:47.358523 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-2ee9bc6f-1bf7-4ea2-9417-159fddd8c652 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Jun 07 08:30:47.358928 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 13/27] 10.222.0.17 () {54 vars in 930 bytes} [Tue Jun 7 08:30:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:30:47.416352 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-a6df801c-9767-42fe-a66e-356b7bf84790 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.medium", "vcpus": 2, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "id": "3"}} {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:30:47.482954 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-a6df801c-9767-42fe-a66e-356b7bf84790 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.118154 Jun 07 08:30:47.483461 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 15/28] 10.222.0.17 () {64 vars in 1282 bytes} [Tue Jun 7 08:30:47 2022] POST /compute/v2.1/flavors => generated 406 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 08:30:47.495223 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-49f83f60-5185-41d8-9d83-1699606289a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:30:47.561129 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-49f83f60-5185-41d8-9d83-1699606289a1 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.069533 Jun 07 08:30:47.561718 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 14/29] 10.222.0.17 () {64 vars in 1332 bytes} [Tue Jun 7 08:30:47 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:30:49.857634 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-a6df801c-9767-42fe-a66e-356b7bf84790 admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:30:49.857634 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-a6df801c-9767-42fe-a66e-356b7bf84790 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jun 07 08:30:49.858598 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 16/30] 10.222.0.17 () {54 vars in 930 bytes} [Tue Jun 7 08:30:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:30:49.916452 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-e2bbfe26-3b8d-42ac-befb-aa51fb2c4e03 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "disk": 80, "name": "m1.large", "id": "4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:30:49.987305 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-e2bbfe26-3b8d-42ac-befb-aa51fb2c4e03 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.123325 Jun 07 08:30:49.987904 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 15/31] 10.222.0.17 () {64 vars in 1282 bytes} [Tue Jun 7 08:30:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 08:30:50.000233 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-bfaf49fe-b4d7-4441-9e07-fd9ef0ca3a44 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:30:50.075637 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-bfaf49fe-b4d7-4441-9e07-fd9ef0ca3a44 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079731 Jun 07 08:30:50.076255 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 17/32] 10.222.0.17 () {64 vars in 1332 bytes} [Tue Jun 7 08:30:49 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:30:52.474092 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-e2bbfe26-3b8d-42ac-befb-aa51fb2c4e03 admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:30:52.474092 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-e2bbfe26-3b8d-42ac-befb-aa51fb2c4e03 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002542 Jun 07 08:30:52.474092 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 16/33] 10.222.0.17 () {54 vars in 930 bytes} [Tue Jun 7 08:30:52 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:30:52.554318 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-64533117-e915-44c6-bab2-5ada2a8e9828 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 8, "swap": 0, "id": "5", "os-flavor-access:is_public": true, "ram": 16384, "name": "m1.xlarge", "disk": 160}} {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:30:52.953235 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-64533117-e915-44c6-bab2-5ada2a8e9828 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.501696 Jun 07 08:30:52.961040 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 18/34] 10.222.0.17 () {64 vars in 1282 bytes} [Tue Jun 7 08:30:52 2022] POST /compute/v2.1/flavors => generated 408 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 08:30:52.965857 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-a2a2686c-7077-488c-a95a-5fee8642be91 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:30:53.075815 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-a2a2686c-7077-488c-a95a-5fee8642be91 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113564 Jun 07 08:30:53.076415 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 17/35] 10.222.0.17 () {64 vars in 1332 bytes} [Tue Jun 7 08:30:52 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:31:18.040513 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-64533117-e915-44c6-bab2-5ada2a8e9828 admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:31:18.041546 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-64533117-e915-44c6-bab2-5ada2a8e9828 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001711 Jun 07 08:31:18.041952 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 19/36] 10.222.0.17 () {54 vars in 930 bytes} [Tue Jun 7 08:31:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:31:18.052741 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG dbcounter [-] [103691] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:31:18.100449 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-56051dbf-d90d-41d0-933a-1890b316873b admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:31:18.118657 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-56051dbf-d90d-41d0-933a-1890b316873b admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070312 Jun 07 08:31:18.121562 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 18/37] 10.222.0.17 () {60 vars in 1291 bytes} [Tue Jun 7 08:31:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:31:19.127898 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-64533117-e915-44c6-bab2-5ada2a8e9828 admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:31:19.128903 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-64533117-e915-44c6-bab2-5ada2a8e9828 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jun 07 08:31:19.129334 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 20/38] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Jun 7 08:31:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:31:19.376500 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-e65d1818-7319-4db2-9111-362497d903a0 admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:31:19.382737 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.wsgi [None req-e65d1818-7319-4db2-9111-362497d903a0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 07 08:31:19.386013 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-e65d1818-7319-4db2-9111-362497d903a0 admin admin] Request method failure captured: Jun 07 08:31:19.386013 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 07 08:31:19.386013 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: Accept: application/json Jun 07 08:31:19.386013 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: Accept-Encoding: gzip, deflate Jun 07 08:31:19.386013 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: Connection: keep-alive Jun 07 08:31:19.386013 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: Content-Length: 0 Jun 07 08:31:19.386013 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: Host: 10.222.0.17 Jun 07 08:31:19.386013 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: Openstack-Api-Version: compute 2.90 Jun 07 08:31:19.386013 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: Openstack-System-Scope: None Jun 07 08:31:19.386013 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: User-Agent: python-novaclient Jun 07 08:31:19.386013 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Auth-Token: gAAAAABinwzXgg3cJ-_tL2jqJnn9VsSzp006m13g_Mb47h_yKwgkK2edf8JnHYfBDQW4uS6RPFLDlURuX2Gi7kf03ImWhgEa8x5idEdk5TQBKhNy-U6eRgdewm70faYJVAIWiptJyKVBI37CXuXL0ywwcYM7CB122GnyLTYiVW3sEO7jVsgGHo8 Jun 07 08:31:19.386013 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Domain-Id: None Jun 07 08:31:19.386013 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Domain-Name: None Jun 07 08:31:19.386013 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Identity-Status: Confirmed Jun 07 08:31:19.386013 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Is-Admin-Project: True Jun 07 08:31:19.386013 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 08:31:19.386013 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Project-Domain-Id: default Jun 07 08:31:19.386013 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Project-Domain-Name: Default Jun 07 08:31:19.386013 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Project-Id: df1e3ab9af2d4109a302f1229baa02a8 Jun 07 08:31:19.386013 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Project-Name: admin Jun 07 08:31:19.386013 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Role: reader,admin,member Jun 07 08:31:19.386013 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Roles: reader,admin,member Jun 07 08:31:19.387742 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df1e3ab9af2d4109a302f1229baa02a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/df1e3ab9af2d4109a302f1229baa02a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_df1e3ab9af2d4109a302f1229baa02a8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df1e3ab9af2d4109a302f1229baa02a8"}]}] Jun 07 08:31:19.387742 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Tenant: admin Jun 07 08:31:19.387742 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Tenant-Id: df1e3ab9af2d4109a302f1229baa02a8 Jun 07 08:31:19.387742 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Tenant-Name: admin Jun 07 08:31:19.387742 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-User: admin Jun 07 08:31:19.387742 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-User-Domain-Id: default Jun 07 08:31:19.387742 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-User-Domain-Name: Default Jun 07 08:31:19.387742 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-User-Id: 4ce5a782a83f41fbb386c88e6d77ba55 Jun 07 08:31:19.387742 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-User-Name: admin Jun 07 08:31:19.387742 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: method: > Jun 07 08:31:19.387742 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: exception: Flavor 42 could not be found. Jun 07 08:31:19.387742 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: action_args: {'id': '42'} Jun 07 08:31:19.387742 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:31:19.387742 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:31:19.388771 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 08:31:19.388771 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 08:31:19.388771 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 08:31:19.388771 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 08:31:19.388771 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 08:31:19.388771 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 08:31:19.388771 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 08:31:19.388771 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 08:31:19.388771 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 08:31:19.388771 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:31:19.388771 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 08:31:19.388771 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 08:31:19.388771 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 07 08:31:19.388771 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Jun 07 08:31:19.388771 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:31:19.388771 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Jun 07 08:31:19.388771 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:31:19.388771 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:31:19.388771 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:31:19.398713 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:31:19.398713 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:31:19.398713 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:31:19.398713 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:31:19.398713 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 08:31:19.398713 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:31:19.398713 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 07 08:31:19.398713 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Jun 07 08:31:19.398713 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:31:19.398713 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Jun 07 08:31:19.398713 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:31:19.398713 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:31:19.398713 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:31:19.398713 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:31:19.398713 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:31:19.398713 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 07 08:31:19.398713 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Jun 07 08:31:19.398713 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-e65d1818-7319-4db2-9111-362497d903a0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:31:19.399984 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-e65d1818-7319-4db2-9111-362497d903a0 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.064684 Jun 07 08:31:19.399984 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 19/39] 10.222.0.17 () {60 vars in 1190 bytes} [Tue Jun 7 08:31:19 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 08:31:19.400152 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-f812d9ce-f737-4652-a4e4-d871db1200bb admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:31:19.400990 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG dbcounter [-] [103692] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:31:19.421147 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-f812d9ce-f737-4652-a4e4-d871db1200bb admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026583 Jun 07 08:31:19.421752 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 21/40] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Jun 7 08:31:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:31:19.446756 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-923d7788-09eb-4d82-8651-9434f1814875 admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:31:19.468527 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-923d7788-09eb-4d82-8651-9434f1814875 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025759 Jun 07 08:31:19.469132 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 20/41] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Jun 7 08:31:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:31:19.478890 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-6c0c4f13-b811-43a6-b317-2ae2e15d29a9 admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:31:19.484535 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.wsgi [None req-6c0c4f13-b811-43a6-b317-2ae2e15d29a9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 07 08:31:19.487736 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-6c0c4f13-b811-43a6-b317-2ae2e15d29a9 admin admin] Request method failure captured: Jun 07 08:31:19.487736 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 07 08:31:19.487736 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: Accept: application/json Jun 07 08:31:19.487736 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: Accept-Encoding: gzip, deflate Jun 07 08:31:19.487736 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: Connection: keep-alive Jun 07 08:31:19.487736 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: Content-Length: 0 Jun 07 08:31:19.487736 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: Host: 10.222.0.17 Jun 07 08:31:19.487736 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: Openstack-Api-Version: compute 2.90 Jun 07 08:31:19.487736 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: Openstack-System-Scope: None Jun 07 08:31:19.487736 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: User-Agent: python-novaclient Jun 07 08:31:19.487736 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Auth-Token: gAAAAABinwzXgg3cJ-_tL2jqJnn9VsSzp006m13g_Mb47h_yKwgkK2edf8JnHYfBDQW4uS6RPFLDlURuX2Gi7kf03ImWhgEa8x5idEdk5TQBKhNy-U6eRgdewm70faYJVAIWiptJyKVBI37CXuXL0ywwcYM7CB122GnyLTYiVW3sEO7jVsgGHo8 Jun 07 08:31:19.487736 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Domain-Id: None Jun 07 08:31:19.487736 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Domain-Name: None Jun 07 08:31:19.487736 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Identity-Status: Confirmed Jun 07 08:31:19.487736 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Is-Admin-Project: True Jun 07 08:31:19.487736 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 08:31:19.487736 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Project-Domain-Id: default Jun 07 08:31:19.487736 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Project-Domain-Name: Default Jun 07 08:31:19.487736 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Project-Id: df1e3ab9af2d4109a302f1229baa02a8 Jun 07 08:31:19.487736 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Project-Name: admin Jun 07 08:31:19.487736 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Role: reader,admin,member Jun 07 08:31:19.487736 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Roles: reader,admin,member Jun 07 08:31:19.489332 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df1e3ab9af2d4109a302f1229baa02a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/df1e3ab9af2d4109a302f1229baa02a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_df1e3ab9af2d4109a302f1229baa02a8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df1e3ab9af2d4109a302f1229baa02a8"}]}] Jun 07 08:31:19.489332 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Tenant: admin Jun 07 08:31:19.489332 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Tenant-Id: df1e3ab9af2d4109a302f1229baa02a8 Jun 07 08:31:19.489332 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Tenant-Name: admin Jun 07 08:31:19.489332 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-User: admin Jun 07 08:31:19.489332 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-User-Domain-Id: default Jun 07 08:31:19.489332 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-User-Domain-Name: Default Jun 07 08:31:19.489332 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-User-Id: 4ce5a782a83f41fbb386c88e6d77ba55 Jun 07 08:31:19.489332 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-User-Name: admin Jun 07 08:31:19.489332 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: method: > Jun 07 08:31:19.489332 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: exception: Flavor 42 could not be found. Jun 07 08:31:19.489332 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: action_args: {'id': '42'} Jun 07 08:31:19.489332 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:31:19.489332 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:31:19.490291 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 08:31:19.490291 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 08:31:19.490291 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 08:31:19.490291 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 08:31:19.490291 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 08:31:19.490291 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 08:31:19.490291 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 08:31:19.490291 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 08:31:19.490291 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 08:31:19.490291 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:31:19.490291 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 08:31:19.490291 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 08:31:19.490291 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 07 08:31:19.490291 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Jun 07 08:31:19.490291 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:31:19.490291 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Jun 07 08:31:19.490291 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:31:19.490291 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:31:19.490291 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:31:19.491356 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:31:19.491356 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:31:19.491356 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:31:19.491356 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:31:19.491356 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 08:31:19.491356 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:31:19.491356 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 07 08:31:19.491356 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Jun 07 08:31:19.491356 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:31:19.491356 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Jun 07 08:31:19.491356 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:31:19.491356 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:31:19.491356 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:31:19.491356 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:31:19.491356 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:31:19.491356 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 07 08:31:19.491356 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Jun 07 08:31:19.491356 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-6c0c4f13-b811-43a6-b317-2ae2e15d29a9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:31:19.492408 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-6c0c4f13-b811-43a6-b317-2ae2e15d29a9 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014266 Jun 07 08:31:19.492408 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 22/42] 10.222.0.17 () {60 vars in 1190 bytes} [Tue Jun 7 08:31:19 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 08:31:20.383395 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-923d7788-09eb-4d82-8651-9434f1814875 admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:31:20.384418 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-923d7788-09eb-4d82-8651-9434f1814875 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jun 07 08:31:20.384814 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 21/43] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Jun 7 08:31:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:31:20.572809 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-5295b9d2-2af0-4dcb-b494-c9de1784de2f admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:31:20.578066 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.wsgi [None req-5295b9d2-2af0-4dcb-b494-c9de1784de2f admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 07 08:31:20.579539 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-5295b9d2-2af0-4dcb-b494-c9de1784de2f admin admin] Request method failure captured: Jun 07 08:31:20.579539 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 07 08:31:20.579539 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: Accept: application/json Jun 07 08:31:20.579539 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: Accept-Encoding: gzip, deflate Jun 07 08:31:20.579539 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: Connection: keep-alive Jun 07 08:31:20.579539 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: Content-Length: 0 Jun 07 08:31:20.579539 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: Host: 10.222.0.17 Jun 07 08:31:20.579539 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: Openstack-Api-Version: compute 2.90 Jun 07 08:31:20.579539 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: Openstack-System-Scope: None Jun 07 08:31:20.579539 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: User-Agent: python-novaclient Jun 07 08:31:20.579539 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Auth-Token: gAAAAABinwzYbG63T_iamOHz6XAvfDOTv3Ekh52AvIsIqItCx6GWm5SMQSYjPzzaAY4pO05tjGRrDq4-ihiRVn96jo-ZWnOec3uNv--wdr0XOcNmLvHwcqOZ8YCprvEfp_XjvztQtgOORMM4DbCiztEmx6CBWCchlxyzCD7JgjbyaU_XFzmDDQU Jun 07 08:31:20.579539 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Domain-Id: None Jun 07 08:31:20.579539 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Domain-Name: None Jun 07 08:31:20.579539 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Identity-Status: Confirmed Jun 07 08:31:20.579539 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Is-Admin-Project: True Jun 07 08:31:20.579539 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 08:31:20.579539 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Project-Domain-Id: default Jun 07 08:31:20.579539 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Project-Domain-Name: Default Jun 07 08:31:20.579539 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Project-Id: df1e3ab9af2d4109a302f1229baa02a8 Jun 07 08:31:20.579539 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Project-Name: admin Jun 07 08:31:20.579539 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Role: reader,admin,member Jun 07 08:31:20.579539 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Roles: reader,admin,member Jun 07 08:31:20.581199 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df1e3ab9af2d4109a302f1229baa02a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/df1e3ab9af2d4109a302f1229baa02a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_df1e3ab9af2d4109a302f1229baa02a8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df1e3ab9af2d4109a302f1229baa02a8"}]}] Jun 07 08:31:20.581199 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Tenant: admin Jun 07 08:31:20.581199 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Tenant-Id: df1e3ab9af2d4109a302f1229baa02a8 Jun 07 08:31:20.581199 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Tenant-Name: admin Jun 07 08:31:20.581199 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-User: admin Jun 07 08:31:20.581199 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-User-Domain-Id: default Jun 07 08:31:20.581199 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-User-Domain-Name: Default Jun 07 08:31:20.581199 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-User-Id: 4ce5a782a83f41fbb386c88e6d77ba55 Jun 07 08:31:20.581199 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-User-Name: admin Jun 07 08:31:20.581199 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: method: > Jun 07 08:31:20.581199 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: exception: Flavor 84 could not be found. Jun 07 08:31:20.581199 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: action_args: {'id': '84'} Jun 07 08:31:20.581199 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:31:20.581199 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:31:20.582393 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 08:31:20.582393 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 08:31:20.582393 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 08:31:20.582393 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 08:31:20.582393 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 08:31:20.582393 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 08:31:20.582393 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 08:31:20.582393 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 08:31:20.582393 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 08:31:20.582393 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:31:20.582393 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 08:31:20.582393 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 08:31:20.582393 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 07 08:31:20.582393 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Jun 07 08:31:20.582393 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:31:20.582393 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Jun 07 08:31:20.582393 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:31:20.582393 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:31:20.582393 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:31:20.583814 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:31:20.583814 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:31:20.583814 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:31:20.583814 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:31:20.583814 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 08:31:20.583814 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:31:20.583814 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 07 08:31:20.583814 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Jun 07 08:31:20.583814 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:31:20.583814 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Jun 07 08:31:20.583814 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:31:20.583814 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:31:20.583814 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:31:20.583814 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:31:20.583814 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:31:20.583814 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 07 08:31:20.583814 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Jun 07 08:31:20.583814 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-5295b9d2-2af0-4dcb-b494-c9de1784de2f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:31:20.585090 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-5295b9d2-2af0-4dcb-b494-c9de1784de2f admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061028 Jun 07 08:31:20.585090 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 23/44] 10.222.0.17 () {60 vars in 1190 bytes} [Tue Jun 7 08:31:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 08:31:20.590527 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-c4764fe7-ae14-4b22-bbde-91650aea2f38 admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:31:20.603810 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-c4764fe7-ae14-4b22-bbde-91650aea2f38 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016809 Jun 07 08:31:20.604330 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 22/45] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Jun 7 08:31:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:31:20.614006 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-a153bb0f-2cc5-49b1-90c5-5f97125fbea2 admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:31:20.628041 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-a153bb0f-2cc5-49b1-90c5-5f97125fbea2 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017495 Jun 07 08:31:20.628591 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 24/46] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Jun 7 08:31:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:31:20.637794 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-e5c1e0b6-4713-4fd6-a4e2-693de3d72618 admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:31:20.643126 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.wsgi [None req-e5c1e0b6-4713-4fd6-a4e2-693de3d72618 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 07 08:31:20.644604 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-e5c1e0b6-4713-4fd6-a4e2-693de3d72618 admin admin] Request method failure captured: Jun 07 08:31:20.644604 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 07 08:31:20.644604 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: Accept: application/json Jun 07 08:31:20.644604 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: Accept-Encoding: gzip, deflate Jun 07 08:31:20.644604 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: Connection: keep-alive Jun 07 08:31:20.644604 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: Content-Length: 0 Jun 07 08:31:20.644604 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: Host: 10.222.0.17 Jun 07 08:31:20.644604 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: Openstack-Api-Version: compute 2.90 Jun 07 08:31:20.644604 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: Openstack-System-Scope: None Jun 07 08:31:20.644604 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: User-Agent: python-novaclient Jun 07 08:31:20.644604 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Auth-Token: gAAAAABinwzYbG63T_iamOHz6XAvfDOTv3Ekh52AvIsIqItCx6GWm5SMQSYjPzzaAY4pO05tjGRrDq4-ihiRVn96jo-ZWnOec3uNv--wdr0XOcNmLvHwcqOZ8YCprvEfp_XjvztQtgOORMM4DbCiztEmx6CBWCchlxyzCD7JgjbyaU_XFzmDDQU Jun 07 08:31:20.644604 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Domain-Id: None Jun 07 08:31:20.644604 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Domain-Name: None Jun 07 08:31:20.644604 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Identity-Status: Confirmed Jun 07 08:31:20.644604 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Is-Admin-Project: True Jun 07 08:31:20.644604 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 08:31:20.644604 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Project-Domain-Id: default Jun 07 08:31:20.644604 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Project-Domain-Name: Default Jun 07 08:31:20.644604 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Project-Id: df1e3ab9af2d4109a302f1229baa02a8 Jun 07 08:31:20.644604 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Project-Name: admin Jun 07 08:31:20.644604 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Role: reader,admin,member Jun 07 08:31:20.644604 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Roles: reader,admin,member Jun 07 08:31:20.645960 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df1e3ab9af2d4109a302f1229baa02a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/df1e3ab9af2d4109a302f1229baa02a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_df1e3ab9af2d4109a302f1229baa02a8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df1e3ab9af2d4109a302f1229baa02a8"}]}] Jun 07 08:31:20.645960 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Tenant: admin Jun 07 08:31:20.645960 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Tenant-Id: df1e3ab9af2d4109a302f1229baa02a8 Jun 07 08:31:20.645960 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Tenant-Name: admin Jun 07 08:31:20.645960 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-User: admin Jun 07 08:31:20.645960 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-User-Domain-Id: default Jun 07 08:31:20.645960 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-User-Domain-Name: Default Jun 07 08:31:20.645960 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-User-Id: 4ce5a782a83f41fbb386c88e6d77ba55 Jun 07 08:31:20.645960 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-User-Name: admin Jun 07 08:31:20.645960 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: method: > Jun 07 08:31:20.645960 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: exception: Flavor 84 could not be found. Jun 07 08:31:20.645960 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: action_args: {'id': '84'} Jun 07 08:31:20.645960 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:31:20.645960 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:31:20.646865 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 08:31:20.646865 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 08:31:20.646865 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 08:31:20.646865 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 08:31:20.646865 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 08:31:20.646865 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 08:31:20.646865 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 08:31:20.646865 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 08:31:20.646865 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 08:31:20.646865 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:31:20.646865 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 08:31:20.646865 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 08:31:20.646865 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 07 08:31:20.646865 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Jun 07 08:31:20.646865 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:31:20.646865 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Jun 07 08:31:20.646865 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:31:20.646865 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:31:20.646865 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:31:20.648272 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:31:20.648272 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:31:20.648272 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:31:20.648272 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:31:20.648272 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 08:31:20.648272 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:31:20.648272 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 07 08:31:20.648272 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Jun 07 08:31:20.648272 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:31:20.648272 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Jun 07 08:31:20.648272 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:31:20.648272 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:31:20.648272 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:31:20.648272 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:31:20.648272 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:31:20.648272 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 07 08:31:20.648272 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Jun 07 08:31:20.648272 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-e5c1e0b6-4713-4fd6-a4e2-693de3d72618 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:31:20.649560 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-e5c1e0b6-4713-4fd6-a4e2-693de3d72618 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011690 Jun 07 08:31:20.649560 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 23/47] 10.222.0.17 () {60 vars in 1190 bytes} [Tue Jun 7 08:31:20 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 07 08:31:21.503881 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-a153bb0f-2cc5-49b1-90c5-5f97125fbea2 admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:31:21.504879 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-a153bb0f-2cc5-49b1-90c5-5f97125fbea2 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jun 07 08:31:21.505340 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 25/48] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Jun 7 08:31:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:31:21.694378 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-250513af-013d-450a-95a8-66a8e408ce2a admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:31:21.700312 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.wsgi [None req-250513af-013d-450a-95a8-66a8e408ce2a admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 07 08:31:21.701854 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-250513af-013d-450a-95a8-66a8e408ce2a admin admin] Request method failure captured: Jun 07 08:31:21.701854 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 07 08:31:21.701854 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: Accept: application/json Jun 07 08:31:21.701854 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: Accept-Encoding: gzip, deflate Jun 07 08:31:21.701854 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: Connection: keep-alive Jun 07 08:31:21.701854 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: Content-Length: 0 Jun 07 08:31:21.701854 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: Host: 10.222.0.17 Jun 07 08:31:21.701854 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: Openstack-Api-Version: compute 2.90 Jun 07 08:31:21.701854 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: Openstack-System-Scope: None Jun 07 08:31:21.701854 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: User-Agent: python-novaclient Jun 07 08:31:21.701854 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Auth-Token: gAAAAABinwzZ3-oKRqZA1wKLlYdrC2QcpxEMnOmE9jPdzfsavHjPqTBcU88stRlE1VBW1khw5Z8w13Z168c_QmVplPAs9tannLgSk1ZJ5aJZ2vwFwXbASculSvwY0eo2rKp8AAPIFDQUIB1JNAcCb4lh6fNgmgkxVp6Bc8QWR80Kw6JJxeLJIR8 Jun 07 08:31:21.701854 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Domain-Id: None Jun 07 08:31:21.701854 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Domain-Name: None Jun 07 08:31:21.701854 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Identity-Status: Confirmed Jun 07 08:31:21.701854 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Is-Admin-Project: True Jun 07 08:31:21.701854 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 08:31:21.701854 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Project-Domain-Id: default Jun 07 08:31:21.701854 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Project-Domain-Name: Default Jun 07 08:31:21.701854 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Project-Id: df1e3ab9af2d4109a302f1229baa02a8 Jun 07 08:31:21.701854 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Project-Name: admin Jun 07 08:31:21.701854 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Role: reader,admin,member Jun 07 08:31:21.701854 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Roles: reader,admin,member Jun 07 08:31:21.703732 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df1e3ab9af2d4109a302f1229baa02a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/df1e3ab9af2d4109a302f1229baa02a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_df1e3ab9af2d4109a302f1229baa02a8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df1e3ab9af2d4109a302f1229baa02a8"}]}] Jun 07 08:31:21.703732 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Tenant: admin Jun 07 08:31:21.703732 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Tenant-Id: df1e3ab9af2d4109a302f1229baa02a8 Jun 07 08:31:21.703732 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-Tenant-Name: admin Jun 07 08:31:21.703732 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-User: admin Jun 07 08:31:21.703732 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-User-Domain-Id: default Jun 07 08:31:21.703732 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-User-Domain-Name: Default Jun 07 08:31:21.703732 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-User-Id: 4ce5a782a83f41fbb386c88e6d77ba55 Jun 07 08:31:21.703732 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: X-User-Name: admin Jun 07 08:31:21.703732 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: method: > Jun 07 08:31:21.703732 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: exception: Flavor 451 could not be found. Jun 07 08:31:21.703732 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: action_args: {'id': '451'} Jun 07 08:31:21.703732 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:31:21.703732 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:31:21.704684 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 08:31:21.704684 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 08:31:21.704684 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 08:31:21.704684 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 08:31:21.704684 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 08:31:21.704684 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 08:31:21.704684 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 08:31:21.704684 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 08:31:21.704684 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 08:31:21.704684 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:31:21.704684 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 08:31:21.704684 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 08:31:21.704684 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 07 08:31:21.704684 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Jun 07 08:31:21.704684 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:31:21.704684 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Jun 07 08:31:21.704684 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:31:21.704684 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:31:21.704684 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:31:21.706532 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:31:21.706532 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:31:21.706532 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:31:21.706532 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:31:21.706532 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 08:31:21.706532 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:31:21.706532 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 07 08:31:21.706532 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Jun 07 08:31:21.706532 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:31:21.706532 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Jun 07 08:31:21.706532 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:31:21.706532 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:31:21.706532 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:31:21.706532 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:31:21.706532 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:31:21.706532 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 07 08:31:21.706532 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: ERROR nova.api.openstack.wsgi Jun 07 08:31:21.706532 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-250513af-013d-450a-95a8-66a8e408ce2a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:31:21.707973 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-250513af-013d-450a-95a8-66a8e408ce2a admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.062000 Jun 07 08:31:21.707973 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 24/49] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Jun 7 08:31:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 07 08:31:21.716480 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-6a8654a8-ac5e-4c54-a0ce-c72ed8b3781a admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:31:21.727750 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-6a8654a8-ac5e-4c54-a0ce-c72ed8b3781a admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017382 Jun 07 08:31:21.728305 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 26/50] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Jun 7 08:31:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:31:21.737809 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-a17408bc-a6fd-4f59-91c4-9887ce197a49 admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:31:21.751708 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-a17408bc-a6fd-4f59-91c4-9887ce197a49 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017487 Jun 07 08:31:21.752240 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 25/51] 10.222.0.17 () {60 vars in 1210 bytes} [Tue Jun 7 08:31:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:31:21.761497 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-396a02e0-0ad2-4eac-a38d-9d70dbf8564d admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:31:21.767435 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.wsgi [None req-396a02e0-0ad2-4eac-a38d-9d70dbf8564d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 07 08:31:21.768915 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-396a02e0-0ad2-4eac-a38d-9d70dbf8564d admin admin] Request method failure captured: Jun 07 08:31:21.768915 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 07 08:31:21.768915 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: Accept: application/json Jun 07 08:31:21.768915 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: Accept-Encoding: gzip, deflate Jun 07 08:31:21.768915 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: Connection: keep-alive Jun 07 08:31:21.768915 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: Content-Length: 0 Jun 07 08:31:21.768915 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: Host: 10.222.0.17 Jun 07 08:31:21.768915 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: Openstack-Api-Version: compute 2.90 Jun 07 08:31:21.768915 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: Openstack-System-Scope: None Jun 07 08:31:21.768915 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: User-Agent: python-novaclient Jun 07 08:31:21.768915 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Auth-Token: gAAAAABinwzZ3-oKRqZA1wKLlYdrC2QcpxEMnOmE9jPdzfsavHjPqTBcU88stRlE1VBW1khw5Z8w13Z168c_QmVplPAs9tannLgSk1ZJ5aJZ2vwFwXbASculSvwY0eo2rKp8AAPIFDQUIB1JNAcCb4lh6fNgmgkxVp6Bc8QWR80Kw6JJxeLJIR8 Jun 07 08:31:21.768915 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Domain-Id: None Jun 07 08:31:21.768915 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Domain-Name: None Jun 07 08:31:21.768915 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Identity-Status: Confirmed Jun 07 08:31:21.768915 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Is-Admin-Project: True Jun 07 08:31:21.768915 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Openstack-Nova-Api-Version: 2.90 Jun 07 08:31:21.768915 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Project-Domain-Id: default Jun 07 08:31:21.768915 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Project-Domain-Name: Default Jun 07 08:31:21.768915 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Project-Id: df1e3ab9af2d4109a302f1229baa02a8 Jun 07 08:31:21.768915 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Project-Name: admin Jun 07 08:31:21.768915 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Role: reader,admin,member Jun 07 08:31:21.768915 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Roles: reader,admin,member Jun 07 08:31:21.771529 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df1e3ab9af2d4109a302f1229baa02a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/df1e3ab9af2d4109a302f1229baa02a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_df1e3ab9af2d4109a302f1229baa02a8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df1e3ab9af2d4109a302f1229baa02a8"}]}] Jun 07 08:31:21.771529 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Tenant: admin Jun 07 08:31:21.771529 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Tenant-Id: df1e3ab9af2d4109a302f1229baa02a8 Jun 07 08:31:21.771529 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-Tenant-Name: admin Jun 07 08:31:21.771529 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-User: admin Jun 07 08:31:21.771529 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-User-Domain-Id: default Jun 07 08:31:21.771529 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-User-Domain-Name: Default Jun 07 08:31:21.771529 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-User-Id: 4ce5a782a83f41fbb386c88e6d77ba55 Jun 07 08:31:21.771529 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: X-User-Name: admin Jun 07 08:31:21.771529 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: method: > Jun 07 08:31:21.771529 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: exception: Flavor 451 could not be found. Jun 07 08:31:21.771529 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: action_args: {'id': '451'} Jun 07 08:31:21.771529 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:31:21.771529 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:31:21.773061 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 07 08:31:21.773061 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 07 08:31:21.773061 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 07 08:31:21.773061 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 07 08:31:21.773061 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 08:31:21.773061 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 08:31:21.773061 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 07 08:31:21.773061 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 07 08:31:21.773061 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 07 08:31:21.773061 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:31:21.773061 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 07 08:31:21.773061 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 07 08:31:21.773061 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 07 08:31:21.773061 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Jun 07 08:31:21.773061 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:31:21.773061 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Jun 07 08:31:21.773061 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:31:21.773061 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:31:21.773061 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:31:21.775049 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:31:21.775049 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:31:21.775049 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:31:21.775049 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:31:21.775049 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 07 08:31:21.775049 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:31:21.775049 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 07 08:31:21.775049 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Jun 07 08:31:21.775049 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:31:21.775049 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Jun 07 08:31:21.775049 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:31:21.775049 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:31:21.775049 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:31:21.775049 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:31:21.775049 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:31:21.775049 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 07 08:31:21.775049 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: ERROR nova.api.openstack.wsgi Jun 07 08:31:21.775049 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-396a02e0-0ad2-4eac-a38d-9d70dbf8564d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:31:21.777041 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-396a02e0-0ad2-4eac-a38d-9d70dbf8564d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012389 Jun 07 08:31:21.777041 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 27/52] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Jun 7 08:31:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 07 08:31:22.638112 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-a17408bc-a6fd-4f59-91c4-9887ce197a49 admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:31:22.639119 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-a17408bc-a6fd-4f59-91c4-9887ce197a49 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jun 07 08:31:22.639523 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 26/53] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Jun 7 08:31:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:31:22.829859 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-6c0f473c-95f2-4d39-8b5d-af641fa962cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:31:22.945984 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-6c0f473c-95f2-4d39-8b5d-af641fa962cd admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.168031 Jun 07 08:31:22.946549 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 28/54] 10.222.0.17 () {64 vars in 1235 bytes} [Tue Jun 7 08:31:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 08:31:23.813225 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-a17408bc-a6fd-4f59-91c4-9887ce197a49 admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:31:23.814229 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-a17408bc-a6fd-4f59-91c4-9887ce197a49 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jun 07 08:31:23.814625 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 27/55] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Jun 7 08:31:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:31:24.004178 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-bfddaf53-9783-4367-b246-94f40b0f8c55 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:31:24.088888 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-bfddaf53-9783-4367-b246-94f40b0f8c55 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.138103 Jun 07 08:31:24.089616 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 29/56] 10.222.0.17 () {64 vars in 1235 bytes} [Tue Jun 7 08:31:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 08:31:24.956045 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-a17408bc-a6fd-4f59-91c4-9887ce197a49 admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:31:24.960337 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-a17408bc-a6fd-4f59-91c4-9887ce197a49 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jun 07 08:31:24.960337 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 28/57] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Jun 7 08:31:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:31:25.147217 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-6129cd4f-9155-4bf2-8288-a10b778411e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:31:25.210939 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-6129cd4f-9155-4bf2-8288-a10b778411e7 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.115778 Jun 07 08:31:25.211488 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 30/58] 10.222.0.17 () {64 vars in 1235 bytes} [Tue Jun 7 08:31:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 08:31:26.096049 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-a17408bc-a6fd-4f59-91c4-9887ce197a49 admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:31:26.097126 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-a17408bc-a6fd-4f59-91c4-9887ce197a49 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jun 07 08:31:26.097616 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 29/59] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Jun 7 08:31:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:31:26.286625 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-8470c152-c2ba-4f53-a847-b175f8f12207 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:31:26.351252 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-8470c152-c2ba-4f53-a847-b175f8f12207 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.116352 Jun 07 08:31:26.351723 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 31/60] 10.222.0.17 () {64 vars in 1235 bytes} [Tue Jun 7 08:31:26 2022] POST /compute/v2.1/flavors => generated 409 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 08:31:27.222413 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-a17408bc-a6fd-4f59-91c4-9887ce197a49 admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:31:27.223419 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-a17408bc-a6fd-4f59-91c4-9887ce197a49 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jun 07 08:31:27.223821 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 30/61] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Jun 7 08:31:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:31:27.411814 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-bead4f60-b4a8-4574-9e89-874f4f6b0f34 admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:31:27.430946 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-bead4f60-b4a8-4574-9e89-874f4f6b0f34 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071525 Jun 07 08:31:27.431490 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 32/62] 10.222.0.17 () {60 vars in 1202 bytes} [Tue Jun 7 08:31:27 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:32:29.876054 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-a17408bc-a6fd-4f59-91c4-9887ce197a49 admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:32:29.877086 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-a17408bc-a6fd-4f59-91c4-9887ce197a49 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 07 08:32:29.877689 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 31/63] 10.222.0.17 () {54 vars in 930 bytes} [Tue Jun 7 08:32:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:32:29.889751 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG dbcounter [-] [103692] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:32:29.941748 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-8dc9edfd-56e1-4f5d-b0bc-4229ddecbe9b admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:32:29.962611 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-8dc9edfd-56e1-4f5d-b0bc-4229ddecbe9b admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.078595 Jun 07 08:32:29.963218 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 33/64] 10.222.0.17 () {60 vars in 1291 bytes} [Tue Jun 7 08:32:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:32:29.984554 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG dbcounter [-] [103691] Writing DB stats nova_api:SELECT=14 {{(pid=103691) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:32:29.988633 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-49b44e4e-f18d-4e3e-9966-65590f1d975e admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:32:29.997093 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-49b44e4e-f18d-4e3e-9966-65590f1d975e admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014171 Jun 07 08:32:29.997650 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 32/65] 10.222.0.17 () {60 vars in 1282 bytes} [Tue Jun 7 08:32:29 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:32:30.011728 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-b2e96614-59d9-4c1c-b5a2-1918a1475844 admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:32:30.020469 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-b2e96614-59d9-4c1c-b5a2-1918a1475844 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013894 Jun 07 08:32:30.021089 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 34/66] 10.222.0.17 () {60 vars in 1285 bytes} [Tue Jun 7 08:32:30 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:32:30.033741 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-5e410cd4-7baa-486f-ac51-8668c05446ab admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:32:30.043394 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-5e410cd4-7baa-486f-ac51-8668c05446ab admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013716 Jun 07 08:32:30.044003 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 33/67] 10.222.0.17 () {60 vars in 1285 bytes} [Tue Jun 7 08:32:30 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:32:30.058572 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-1eec397b-10ff-4cd9-acea-e72eb95ea4c7 admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:32:30.069361 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-1eec397b-10ff-4cd9-acea-e72eb95ea4c7 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015636 Jun 07 08:32:30.070284 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 35/68] 10.222.0.17 () {60 vars in 1282 bytes} [Tue Jun 7 08:32:30 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:36:01.268579 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-5e410cd4-7baa-486f-ac51-8668c05446ab admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:36:01.269633 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-5e410cd4-7baa-486f-ac51-8668c05446ab admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jun 07 08:36:01.270035 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 34/69] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Jun 7 08:36:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:36:01.430968 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG dbcounter [-] [103692] Writing DB stats nova_api:SELECT=6 {{(pid=103692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:36:01.561158 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-b2e16e19-de42-4fa1-b9c9-9d4d73b4cb34 admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:36:01.562325 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 08:36:01.562325 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: warnings.warn(msg) Jun 07 08:36:01.563492 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-b2e16e19-de42-4fa1-b9c9-9d4d73b4cb34 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:36:01.563920 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-b2e16e19-de42-4fa1-b9c9-9d4d73b4cb34 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:36:01.564721 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-b2e16e19-de42-4fa1-b9c9-9d4d73b4cb34 admin admin] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:36:01.565168 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-b2e16e19-de42-4fa1-b9c9-9d4d73b4cb34 admin admin] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:36:01.599850 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-b2e16e19-de42-4fa1-b9c9-9d4d73b4cb34 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.170210 Jun 07 08:36:01.600426 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 36/70] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Jun 7 08:36:01 2022] GET /compute/v2.1/os-services => generated 794 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 08:36:02.489271 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-5e410cd4-7baa-486f-ac51-8668c05446ab admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:36:02.490396 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-5e410cd4-7baa-486f-ac51-8668c05446ab admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001679 Jun 07 08:36:02.490854 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 35/71] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Jun 7 08:36:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:36:02.687380 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-b288ef1d-076b-4da5-94a8-f173141c4082 admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:36:02.688605 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 08:36:02.688605 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: warnings.warn(msg) Jun 07 08:36:02.689804 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-b288ef1d-076b-4da5-94a8-f173141c4082 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:36:02.690315 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-b288ef1d-076b-4da5-94a8-f173141c4082 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:36:02.691095 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-b288ef1d-076b-4da5-94a8-f173141c4082 admin admin] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:36:02.691516 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-b288ef1d-076b-4da5-94a8-f173141c4082 admin admin] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:36:02.712088 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-b288ef1d-076b-4da5-94a8-f173141c4082 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.081027 Jun 07 08:36:02.712667 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 37/72] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Jun 7 08:36:02 2022] GET /compute/v2.1/os-services => generated 794 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 08:36:14.013676 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-5e410cd4-7baa-486f-ac51-8668c05446ab admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:36:14.018281 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-5e410cd4-7baa-486f-ac51-8668c05446ab admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jun 07 08:36:14.018281 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 36/73] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Jun 7 08:36:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:36:14.160374 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG dbcounter [-] [103692] Writing DB stats nova_cell0:SELECT=4 {{(pid=103692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:36:14.161120 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG dbcounter [-] [103692] Writing DB stats nova_cell1:SELECT=4 {{(pid=103692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:36:14.162718 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG dbcounter [-] [103692] Writing DB stats nova_api:SELECT=8 {{(pid=103692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:36:14.213840 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-8ee6314a-8f58-49b5-a35c-5e9b130024b6 admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:36:14.215046 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 08:36:14.215046 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: warnings.warn(msg) Jun 07 08:36:14.216281 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-8ee6314a-8f58-49b5-a35c-5e9b130024b6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:36:14.216660 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-8ee6314a-8f58-49b5-a35c-5e9b130024b6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:36:14.217469 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-8ee6314a-8f58-49b5-a35c-5e9b130024b6 admin admin] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:36:14.218035 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-8ee6314a-8f58-49b5-a35c-5e9b130024b6 admin admin] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:36:14.244454 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-8ee6314a-8f58-49b5-a35c-5e9b130024b6 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.088304 Jun 07 08:36:14.245045 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 38/74] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Jun 7 08:36:14 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:36:15.137060 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: DEBUG nova.api.openstack.wsgi [None req-5e410cd4-7baa-486f-ac51-8668c05446ab admin admin] Calling method '>' {{(pid=103691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:36:15.138126 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: INFO nova.api.openstack.requestlog [None req-5e410cd4-7baa-486f-ac51-8668c05446ab admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Jun 07 08:36:15.138469 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: [pid: 103691|app: 0|req: 37/75] 10.222.0.17 () {56 vars in 1074 bytes} [Tue Jun 7 08:36:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:36:15.331925 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG nova.api.openstack.wsgi [None req-43e87b1c-f8eb-453f-ae84-efdbe64a780e admin admin] Calling method '>' {{(pid=103692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:36:15.333139 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 07 08:36:15.333139 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: warnings.warn(msg) Jun 07 08:36:15.334358 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-43e87b1c-f8eb-453f-ae84-efdbe64a780e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:36:15.334793 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-43e87b1c-f8eb-453f-ae84-efdbe64a780e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:36:15.335597 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-43e87b1c-f8eb-453f-ae84-efdbe64a780e admin admin] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:36:15.336018 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: DEBUG oslo_concurrency.lockutils [None req-43e87b1c-f8eb-453f-ae84-efdbe64a780e admin admin] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:36:15.361290 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: INFO nova.api.openstack.requestlog [None req-43e87b1c-f8eb-453f-ae84-efdbe64a780e admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.083153 Jun 07 08:36:15.361775 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: [pid: 103692|app: 0|req: 39/76] 10.222.0.17 () {60 vars in 1193 bytes} [Tue Jun 7 08:36:15 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:37:15.962476 dv-cinder-740146-15-iscsi devstack@n-api.service[103690]: Tue Jun 7 08:37:15 2022 - graceful shutdown triggered... Jun 07 08:37:15.963261 dv-cinder-740146-15-iscsi devstack@n-api.service[103691]: Gracefully killing worker 1 (pid: 103691)... Jun 07 08:37:15.962590 dv-cinder-740146-15-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 07 08:37:15.964086 dv-cinder-740146-15-iscsi devstack@n-api.service[103692]: Gracefully killing worker 2 (pid: 103692)... Jun 07 08:37:16.963621 dv-cinder-740146-15-iscsi devstack@n-api.service[103690]: worker 1 buried after 1 seconds Jun 07 08:37:16.963621 dv-cinder-740146-15-iscsi devstack@n-api.service[103690]: worker 2 buried after 1 seconds Jun 07 08:37:16.963621 dv-cinder-740146-15-iscsi devstack@n-api.service[103690]: goodbye to uWSGI. Jun 07 08:37:16.965193 dv-cinder-740146-15-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 07 08:37:16.965761 dv-cinder-740146-15-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 07 08:37:16.968460 dv-cinder-740146-15-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 07 08:37:16.982203 dv-cinder-740146-15-iscsi devstack@n-api.service[129714]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 07 08:37:16.995023 dv-cinder-740146-15-iscsi devstack@n-api.service[129714]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 7 08:37:16 2022] *** Jun 07 08:37:16.995023 dv-cinder-740146-15-iscsi devstack@n-api.service[129714]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 07 08:37:16.995023 dv-cinder-740146-15-iscsi devstack@n-api.service[129714]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 07 08:37:16.995023 dv-cinder-740146-15-iscsi devstack@n-api.service[129714]: nodename: dv-cinder-740146-15-iscsi Jun 07 08:37:16.995023 dv-cinder-740146-15-iscsi devstack@n-api.service[129714]: machine: x86_64 Jun 07 08:37:16.995023 dv-cinder-740146-15-iscsi devstack@n-api.service[129714]: clock source: unix Jun 07 08:37:16.995023 dv-cinder-740146-15-iscsi devstack@n-api.service[129714]: pcre jit disabled Jun 07 08:37:16.995023 dv-cinder-740146-15-iscsi devstack@n-api.service[129714]: detected number of CPU cores: 4 Jun 07 08:37:16.995023 dv-cinder-740146-15-iscsi devstack@n-api.service[129714]: current working directory: / Jun 07 08:37:16.995023 dv-cinder-740146-15-iscsi devstack@n-api.service[129714]: detected binary path: /usr/bin/uwsgi-core Jun 07 08:37:16.995023 dv-cinder-740146-15-iscsi devstack@n-api.service[129714]: your processes number limit is 47680 Jun 07 08:37:16.995023 dv-cinder-740146-15-iscsi devstack@n-api.service[129714]: your memory page size is 4096 bytes Jun 07 08:37:16.995023 dv-cinder-740146-15-iscsi devstack@n-api.service[129714]: detected max file descriptor number: 2048 Jun 07 08:37:16.995023 dv-cinder-740146-15-iscsi devstack@n-api.service[129714]: lock engine: pthread robust mutexes Jun 07 08:37:16.996171 dv-cinder-740146-15-iscsi devstack@n-api.service[129714]: thunder lock: enabled Jun 07 08:37:16.996171 dv-cinder-740146-15-iscsi devstack@n-api.service[129714]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 07 08:37:16.996171 dv-cinder-740146-15-iscsi devstack@n-api.service[129714]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 07 08:37:17.043141 dv-cinder-740146-15-iscsi devstack@n-api.service[129714]: Python main interpreter initialized at 0x55e2408b19c0 Jun 07 08:37:17.043141 dv-cinder-740146-15-iscsi devstack@n-api.service[129714]: python threads support enabled Jun 07 08:37:17.043141 dv-cinder-740146-15-iscsi devstack@n-api.service[129714]: your server socket listen backlog is limited to 100 connections Jun 07 08:37:17.043141 dv-cinder-740146-15-iscsi devstack@n-api.service[129714]: your mercy for graceful operations on workers is 90 seconds Jun 07 08:37:17.043774 dv-cinder-740146-15-iscsi devstack@n-api.service[129714]: mapped 403077 bytes (393 KB) for 2 cores Jun 07 08:37:17.043774 dv-cinder-740146-15-iscsi devstack@n-api.service[129714]: *** Operational MODE: preforking *** Jun 07 08:37:17.043926 dv-cinder-740146-15-iscsi devstack@n-api.service[129714]: *** uWSGI is running in multiple interpreter mode *** Jun 07 08:37:17.043926 dv-cinder-740146-15-iscsi devstack@n-api.service[129714]: spawned uWSGI master process (pid: 129714) Jun 07 08:37:17.044128 dv-cinder-740146-15-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 07 08:37:17.044751 dv-cinder-740146-15-iscsi devstack@n-api.service[129714]: spawned uWSGI worker 1 (pid: 129725, cores: 1) Jun 07 08:37:17.045137 dv-cinder-740146-15-iscsi devstack@n-api.service[129714]: spawned uWSGI worker 2 (pid: 129726, cores: 1) Jun 07 08:37:17.045298 dv-cinder-740146-15-iscsi devstack@n-api.service[129714]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 07 08:37:18.329559 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 08:37:18.368927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 07 08:37:19.175247 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 08:37:19.175247 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: from cryptography.utils import int_from_bytes Jun 07 08:37:19.175992 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 08:37:19.175992 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: from cryptography.utils import int_from_bytes Jun 07 08:37:19.222793 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 08:37:19.222793 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: from cryptography.utils import int_from_bytes Jun 07 08:37:19.223115 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 07 08:37:19.223115 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: from cryptography.utils import int_from_bytes Jun 07 08:37:21.596136 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 08:37:21.596136 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 08:37:21.596136 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 08:37:21.596136 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 08:37:21.596136 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 08:37:21.596136 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.596136 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.596136 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.597173 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.597173 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.597173 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.597173 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.597173 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.597173 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.597173 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.597632 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.598055 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-740146-15-iscsi {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.598178 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.598471 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.598791 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.599117 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.599427 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.599756 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.600069 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.603216 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.603216 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.603216 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.603216 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.603216 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.603216 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.603737 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.603737 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.603737 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.603737 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.604044 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.604328 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-740146-15-iscsi {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.604596 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.604922 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.605278 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.605694 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.606024 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.606339 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.606658 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.606980 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.607311 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.607634 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.607951 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.608284 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.608608 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.608919 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.609255 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.609566 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.609886 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.610197 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.610506 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.610769 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.611079 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.611408 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.611736 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.612063 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.612324 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.612582 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.612909 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.613259 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.613577 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.613890 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.614201 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.614610 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.614826 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.615133 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.615444 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.615753 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.616084 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.616406 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.616737 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.617078 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.617408 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.618399 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.618661 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.618980 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.619333 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.619661 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.619979 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.620370 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.620663 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.620950 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.626506 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.626506 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.626506 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.626506 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.626506 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.626506 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.626506 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.626506 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.627762 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.627762 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.627762 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.627762 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.627762 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.627762 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.627762 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.627762 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.628915 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.628915 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.628915 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.628915 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.628915 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.628915 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.628915 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.628915 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.630201 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.630201 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.630201 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.630201 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.630201 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.630201 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.631076 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.631076 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.631076 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.631574 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.631574 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.631867 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.632519 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.632519 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.632840 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.634533 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.634533 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.634533 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.635027 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.635027 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.635356 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.635514 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.635784 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.636093 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.636405 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.636713 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.637061 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.637412 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.637716 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.638033 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.638340 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.638663 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:21.639015 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.639358 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.639713 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.640038 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.640410 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.640712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.641063 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.641389 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.641713 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.642046 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.642364 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.642684 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.643004 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.643380 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.643651 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.643992 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.644338 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.644677 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.645013 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.645375 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.645675 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.646025 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.646359 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.646683 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.647032 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.647386 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.647710 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.648050 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.648380 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.648703 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.649088 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.649419 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.649753 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.650099 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.650424 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.650766 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.651080 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.651403 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.651726 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.652049 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.652382 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.652724 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.653072 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.656564 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.656564 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.656564 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.656564 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.656564 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.656564 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.656564 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.656564 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.657794 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.657794 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.657794 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.657794 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.657794 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.657794 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.657794 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.658260 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.658361 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.658769 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.658965 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.659279 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.659606 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.659927 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.660240 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.660844 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.661183 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.661498 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.661830 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.662148 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.662461 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.662784 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.663110 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.663429 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.663748 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.664067 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.664434 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.664772 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.665122 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.665472 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.665812 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.666127 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.666462 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.666798 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.667128 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.667469 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.667747 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.668062 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.668398 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.668696 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.669027 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.669351 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.669666 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.669980 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.670299 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.670604 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.670938 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.671255 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.671572 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.671885 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.672199 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.672559 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.672870 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.673269 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.673622 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.673930 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.674264 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.674587 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.674916 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.675237 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.675561 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.675884 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.676206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.676538 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.676859 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.677215 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.677539 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.677875 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.678198 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.678535 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.678871 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.679585 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.679585 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.679843 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.680729 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.681093 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.681422 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.681750 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.682071 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.682395 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.682710 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.683047 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.683359 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.683682 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.684011 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.684332 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.684665 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.684990 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.685345 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.685661 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.685989 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.686334 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.686677 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.686996 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.687320 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.687653 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.687976 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.688295 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.688623 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.688939 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.689295 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.689603 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.690457 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.690457 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.690628 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.690848 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.691173 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.691491 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.691804 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.692121 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.692441 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.692775 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.693125 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.693456 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.693788 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.694102 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.694414 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.694746 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.695065 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.695381 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.695762 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.696613 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.696945 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.697297 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.697616 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.697963 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.698283 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.698605 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.698947 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.699268 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.699718 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.699918 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.700246 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.700567 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.700890 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.701240 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.701564 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.701885 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.702263 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.702542 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.702865 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.703186 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.703503 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.703821 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.704147 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.704765 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.705118 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.710718 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.710718 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.710718 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.710718 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.710718 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.710718 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.710718 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.710718 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.711634 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.711634 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.711634 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.711634 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.711634 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.711634 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.711634 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.711634 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.712625 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.712625 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.712625 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.712625 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.712625 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.712625 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.712625 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.712625 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.713671 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.713671 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.713671 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.714026 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.714188 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.714872 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.714872 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.715334 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.715707 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.716376 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.716767 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.717248 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.717882 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.718203 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.718527 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.718846 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.719174 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.719502 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.719820 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.720176 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.720467 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.720790 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.721139 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.721522 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.721764 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.722083 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.722408 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.722731 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.723022 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.723440 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.723682 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.724018 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.724245 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.725201 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.725201 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.725201 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.725884 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.725884 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.726339 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.726602 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.726822 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.727041 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.727360 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.727713 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.728060 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.728298 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.728721 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.728951 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.729613 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.729613 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.730112 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.730373 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.730670 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.730892 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.731113 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.731627 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.731881 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.732105 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.732352 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.732595 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.732973 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.738382 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.738382 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.738382 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.738382 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.738382 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.738382 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.738382 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.738382 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.739646 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.739646 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.739646 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.739646 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.739646 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.739646 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.739646 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.739646 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.740590 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.740590 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.740590 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.740590 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.740590 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.740590 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.740590 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.741615 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.741615 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.741615 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.741987 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.741987 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.743082 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.743252 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.744638 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.744638 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.744638 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.744638 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.744638 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.745517 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.745517 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.745856 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.746003 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.746262 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.746550 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.746872 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.747184 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.747516 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.747838 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.748148 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.748468 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.748782 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.749128 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.749444 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.749902 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.750222 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.750542 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.750856 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.751177 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.751498 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.751885 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.752142 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.752527 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.752877 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.753226 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.753663 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.753988 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.754176 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.754480 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.754800 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.755156 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.755450 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.755763 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.756076 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.756415 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.756720 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.757082 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.757511 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.757923 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.758854 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.759253 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.759547 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.759875 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.760209 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.760540 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.760872 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.761221 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.761594 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.761938 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.762274 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.762641 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.762929 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.763290 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.763600 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.763935 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.764269 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.764597 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.764926 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.765391 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.766064 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.766064 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.766347 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.766681 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.766998 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.767337 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.767634 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.767966 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.768268 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.768598 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.768990 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.769256 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.769579 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.769906 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.770216 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.770530 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.770859 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.771168 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.771696 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.771818 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.772131 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.772463 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.772777 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.773135 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.773460 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.773795 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.774116 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.774454 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.777030 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.777030 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.777030 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.777030 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.777030 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.777030 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.777030 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.777030 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.778258 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.778258 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.778258 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.778508 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.778609 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.779813 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.779813 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.779813 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.779813 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.780180 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.780898 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.780898 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.781140 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.781793 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.781793 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.781970 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.782298 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.782644 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.783071 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.783218 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.783573 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.783889 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.784233 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.784560 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.784891 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.785259 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.785846 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.786179 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.786506 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.786830 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.787159 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.787486 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.787916 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.788134 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.788458 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.788778 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.789134 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.789489 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.789825 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.790404 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.790744 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.791069 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.791393 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.791712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.792036 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.792368 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.792731 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.793033 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.795619 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.795619 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.795619 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.795619 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.795619 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.795619 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.795619 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.795619 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.796245 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.796245 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.796539 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.796863 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.797209 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.797533 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.797857 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.798176 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.798522 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.798817 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.799141 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.799459 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.799788 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.800105 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.800435 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.800748 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.801107 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.801452 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.801788 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.802112 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.802436 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.802761 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.803331 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.803668 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.804005 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.804339 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.804676 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.805540 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.805889 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.806228 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.806544 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.806858 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.807188 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.807500 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.807865 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.808171 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.808465 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.808783 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.809602 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.809602 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.810084 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.810396 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.810785 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.811065 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.811402 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.811727 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.812042 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.812373 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.812691 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.813050 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.813374 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.813677 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.814045 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.814395 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.814624 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.814949 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.815261 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.815579 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.815898 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.816236 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.816550 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.816864 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.817206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.817531 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.817849 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.818160 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.818473 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.818786 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.819655 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.819655 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.819831 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.820013 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.820353 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.820711 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.821565 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.821951 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.824537 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.824537 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.824537 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.824537 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.824537 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.824537 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.824537 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.824537 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.825290 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.825290 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.825717 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.826061 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.826419 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.826745 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.827082 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.827403 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.827720 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.828034 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.828367 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.828688 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.829047 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.829427 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.829749 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.830075 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.830397 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.830736 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.831035 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.831354 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.831676 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.831989 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.832308 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.832626 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.832952 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.833335 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.833671 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.833997 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.834324 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.834657 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.834978 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.835302 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.835946 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.835946 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.836268 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.836623 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.836956 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.837269 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.837712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.838039 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.838366 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.838699 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.839048 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.839350 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.839675 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.840002 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.840333 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.840655 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.840988 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.841362 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.841701 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.842033 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.842371 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.842649 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.842961 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.843278 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.843607 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.844055 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.844231 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.845209 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.845209 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.845209 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.845513 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.845784 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.846097 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.846459 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.846730 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.847041 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.847354 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.847664 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.847972 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.848280 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.848596 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.848907 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.849247 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.849558 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.849877 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.850187 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.851196 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.851196 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.851196 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.851768 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.852492 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.852661 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.852975 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.853330 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.853662 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.853990 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.854318 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.854659 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.854979 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.855301 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.855619 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.855938 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.856258 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.856577 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.856916 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.857285 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.857599 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.857929 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.858258 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.858584 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.858908 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.859230 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.859567 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.859888 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.860206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.860537 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.860858 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.861206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.861536 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.861866 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.862203 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.862534 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.862859 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.863191 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.863525 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.863884 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.864208 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.864562 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.864899 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.865269 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.865595 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.865908 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:21.866159 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129726) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 08:37:21.936421 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO dbcounter [None req-fa1cde0a-66c8-4b30-a108-a89377f26514 None None] Registered counter for database nova_api Jun 07 08:37:21.964416 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_db.sqlalchemy.engines [None req-fa1cde0a-66c8-4b30-a108-a89377f26514 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 08:37:21.973111 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writer thread running {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 08:37:22.037486 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.context [None req-fa1cde0a-66c8-4b30-a108-a89377f26514 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),68d8339a-f93e-465c-95c1-304743b93326(cell1) {{(pid=129726) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 08:37:22.042457 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fa1cde0a-66c8-4b30-a108-a89377f26514 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:37:22.044084 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fa1cde0a-66c8-4b30-a108-a89377f26514 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:37:22.048083 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fa1cde0a-66c8-4b30-a108-a89377f26514 None None] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:37:22.048083 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fa1cde0a-66c8-4b30-a108-a89377f26514 None None] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:37:22.049019 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO dbcounter [None req-fa1cde0a-66c8-4b30-a108-a89377f26514 None None] Registered counter for database nova_cell0 Jun 07 08:37:22.054856 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO dbcounter [None req-fa1cde0a-66c8-4b30-a108-a89377f26514 None None] Registered counter for database nova_cell1 Jun 07 08:37:22.063004 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_db.sqlalchemy.engines [None req-fa1cde0a-66c8-4b30-a108-a89377f26514 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 08:37:22.065268 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_db.sqlalchemy.engines [None req-fa1cde0a-66c8-4b30-a108-a89377f26514 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 08:37:22.071042 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writer thread running {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 08:37:22.072373 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writer thread running {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 08:37:22.223504 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO dbcounter [None req-fa1cde0a-66c8-4b30-a108-a89377f26514 None None] Registered counter for database nova_cell0 Jun 07 08:37:22.231445 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_db.sqlalchemy.engines [None req-fa1cde0a-66c8-4b30-a108-a89377f26514 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129726) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 08:37:22.236326 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writer thread running {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 08:37:22.307827 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 07 08:37:22.308392 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 07 08:37:22.308762 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 07 08:37:22.309160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 07 08:37:22.309418 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 07 08:37:22.309808 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.310136 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.310457 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.310776 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.311107 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.311414 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.311735 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.312061 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.312386 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.312646 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.312959 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.313328 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-740146-15-iscsi {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.313651 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.313959 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.314269 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.314652 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.314995 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.315319 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.315625 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.316133 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.316459 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.316757 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.317180 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.317521 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.317866 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.318227 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.318549 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.318859 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.319186 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.319493 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.319895 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-740146-15-iscsi {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.320212 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.320565 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.320973 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.321421 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.321733 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.322103 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.322453 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.322779 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.323088 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.323413 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.323732 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.324049 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.324368 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.324672 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.324980 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.325315 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.325813 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.326774 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.326774 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.326947 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.327164 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.327529 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.327851 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.328191 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.328486 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.328737 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.329094 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.329424 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.329734 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.330043 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.330499 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.330677 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.330939 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.331250 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.331584 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.331892 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.332215 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.332707 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.332898 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.333386 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.333541 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.333948 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.334202 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.334511 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.334853 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.335493 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.335493 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.335792 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.336150 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.337089 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.337417 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.337712 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.338050 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.338473 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.338727 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.339066 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.339400 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.339708 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.340026 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.340332 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.340638 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.340944 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.341354 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.341581 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.343714 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.343714 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.343714 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.343714 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.343714 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.343714 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.343714 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.344307 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.344307 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.344537 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.344843 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.345177 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.345485 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.345790 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.346108 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.346414 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.346717 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.347035 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.347342 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.347650 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.347966 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.348270 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.348580 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.348891 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.349214 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.349522 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.349836 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.350140 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.350445 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.350749 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.351052 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.351353 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.351661 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.352017 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.352825 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.353146 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.353466 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.353785 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.354093 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.354398 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.354699 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.355016 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 07 08:37:22.355353 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.355683 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.356023 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.356920 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.356920 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.357282 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.357369 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.357630 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.357945 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.358266 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.358578 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.358892 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.359201 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.359518 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.359836 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.360162 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.360475 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.360792 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.361134 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.361448 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.361764 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.362089 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.364591 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.364591 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.364591 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.364591 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.364591 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.364591 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.364591 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.364591 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.365303 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.365303 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.365518 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.365887 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.366396 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.366800 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.367119 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.367473 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.367907 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.368228 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.368545 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.368886 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.369233 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.369555 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.369872 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.370189 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.370502 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.370815 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.371128 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.371428 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.371725 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.372035 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.372343 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.372653 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.372976 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.373339 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.373674 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.374010 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.374318 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.374675 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.374983 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.375399 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.375763 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.376143 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.376502 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.376840 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.377278 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.377596 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.377905 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.378231 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.378538 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.378845 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.379471 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.379836 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.380261 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.380690 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.381113 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.381448 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.381770 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.382161 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.382428 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.382762 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.383192 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.383997 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.384432 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.384909 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.385286 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.385824 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.386208 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.386673 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.387073 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.387401 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.387818 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.388135 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.388479 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.388809 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.389131 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.389463 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.389778 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.390088 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.390399 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.390705 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.391050 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.391362 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.391712 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.392044 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.392367 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.392696 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.393063 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.393351 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.400160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.400160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.400160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.400160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.400160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.400160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.400160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.400160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.400716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.400716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.400716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.400716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.400716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.400716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.400716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.400716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.401331 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.401331 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.401331 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.401331 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.401331 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.401331 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.401331 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.401331 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.402100 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.402100 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.402391 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.402534 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.402856 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.403231 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.403535 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.403751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.404088 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.404421 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.404861 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.405126 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.405410 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.405697 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.406007 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.406322 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.406631 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.407100 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.407416 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.407820 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.408136 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.408447 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.408967 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.409145 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.409491 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.410834 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.410834 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.410834 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.411117 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.411381 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.411707 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.412029 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.412335 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.413703 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.413703 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.413703 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.413703 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.414006 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.414161 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.415311 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.415519 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.415683 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.416009 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.416332 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.416646 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.416969 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.418395 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.418780 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.419269 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.419602 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.419925 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.420249 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.420570 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.420892 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.421240 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.421572 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.421890 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.422210 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.422526 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.422845 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.423156 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.423479 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.424065 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.424404 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.424724 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.425075 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.425417 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.425726 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.429710 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.429710 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.429710 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.429710 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.429710 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.429710 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.429710 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.429710 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.430418 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.430418 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.430418 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.430418 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.430418 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.430418 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.430418 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.430961 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.430961 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.431194 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.431507 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.431813 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.432138 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.432448 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.432754 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.433115 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.433397 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.433745 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.434058 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.434393 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.438875 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.438875 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.438875 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.438875 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.438875 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.438875 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.438875 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.438875 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.439576 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.439576 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.439576 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.439576 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.439576 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.439576 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.439576 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.439576 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.440141 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.440141 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.440515 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.440912 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.441253 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.441667 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.441873 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.442187 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.445080 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.445080 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.445080 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.445080 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.445080 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.445080 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.445080 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.445080 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.446099 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.446099 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.446099 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.446099 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.446620 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.446620 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.446867 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.448023 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.448023 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.448023 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.448023 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.448815 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.448815 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.449245 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.449245 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.449496 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.449792 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.450268 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.450738 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.451210 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.451516 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.451825 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.452133 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.452457 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.452767 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.453106 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.453461 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.453708 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.454051 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.454351 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.455009 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.455009 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.455519 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.455754 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.455919 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.456200 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.456512 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.456817 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.457155 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.457469 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.457783 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.458086 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.458395 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.458712 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.459023 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.459335 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.459660 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.459966 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.460338 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.460611 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.461131 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.462304 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.462304 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.462780 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.462780 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.464221 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.464221 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.464221 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.464221 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.464221 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.465547 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.465547 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.465547 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.465547 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.466463 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.466463 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.466463 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.467512 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.467512 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.467512 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.468158 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.468158 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.468513 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.468680 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.468859 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.469272 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.469588 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.469912 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.470291 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.470528 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.471034 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.471297 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.471585 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.471837 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.472840 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.472840 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.472840 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.473529 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.473529 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.474097 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.474097 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.474545 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.474545 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.475177 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.475455 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.475735 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.475968 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.476240 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.476576 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.476852 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.477922 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.478187 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.478435 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.478747 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.479066 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.479377 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.479699 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.480021 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.480333 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.480653 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.480959 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.481316 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.481644 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.481953 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.482893 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.482893 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.483391 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.483683 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.484064 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.484064 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.484530 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.484982 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.484982 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.485461 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.485708 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.485939 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.486167 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.486486 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.486800 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.487116 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.487424 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.488033 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.488033 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.488493 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.488728 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.488961 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.489299 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.489623 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.489931 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.490257 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.490569 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.490881 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.491187 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.491598 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.491838 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.492121 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.492709 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.493386 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.493386 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.493693 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.493853 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.494142 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.494525 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.494741 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.495071 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.495413 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.495780 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.496018 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.496285 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.496545 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.496844 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.498040 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.498040 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.498040 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.498040 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.499241 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.499241 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.499241 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.499241 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.500430 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.500430 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.500430 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.501248 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.501248 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.501248 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.502067 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.502067 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.502542 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.503124 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.503124 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.504111 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.504111 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.504111 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.504111 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.505149 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.505149 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.505149 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.505614 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.505768 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.505992 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.506311 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.506899 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.507240 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.507563 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.508056 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.508792 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.508792 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.509323 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.509323 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.509836 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.510077 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.510301 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.510563 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.510828 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.511156 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.511497 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.511948 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.512190 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.512415 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.512831 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.519930 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.519930 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.519930 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.519930 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.519930 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.519930 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.519930 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.520927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.520927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.520927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.520927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.520927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.520927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.520927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.520927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.522059 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.522059 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.522059 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.522059 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.522059 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.522059 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.522059 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.522059 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.523046 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.523046 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.523046 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.523046 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.523046 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.523046 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.523046 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.523046 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.524595 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.524595 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.524595 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.524595 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.529161 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.529161 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.529161 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.529161 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.529161 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.529161 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.529161 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.529161 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.530793 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.530793 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.530793 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.530793 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.530793 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.530793 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.530793 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.530793 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.533138 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.533138 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.533138 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.533138 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.533138 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.533138 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.533138 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.533138 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.535920 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.535920 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.535920 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.535920 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.535920 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.535920 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.535920 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.535920 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.537299 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.537299 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.537299 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.537299 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.537299 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.537299 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.537299 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.537299 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.538738 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.538738 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.538738 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.538738 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.538738 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.540672 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.540672 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.540672 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.540672 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.541332 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.541332 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.541670 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.542011 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.542343 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.542682 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.542957 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.543262 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.543591 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.543907 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.544221 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.544537 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.544837 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.545181 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.545935 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.545935 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.546678 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.546678 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.546678 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.547401 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.547401 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.547781 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.547937 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.548184 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.548505 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.548822 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.549467 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.549467 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.549808 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.550081 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.550391 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.550737 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.551001 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.551457 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.551668 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.551943 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.552376 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.552692 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.553053 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.553353 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.553835 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.554225 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.554547 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.554756 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.554915 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.555813 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.556138 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.556443 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.556775 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.557128 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.557437 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.557744 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.558150 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.558352 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.559301 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.559301 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.559301 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.560086 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.560086 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.560398 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.560558 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.560764 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.561187 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.561445 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.561703 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.561965 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.562264 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.562568 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.562871 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.563179 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.563479 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.563785 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.564134 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.564419 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.564676 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.564977 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.565346 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.565674 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.565993 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.566337 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.566611 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.566938 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.567238 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.567558 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.567877 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.568195 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.568505 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.568839 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.569181 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.569495 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.569912 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.570090 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.570403 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.570794 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.571679 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.571944 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.572252 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.572586 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.572907 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.573264 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.573690 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.573930 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.574197 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.574754 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.575236 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.575236 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.575749 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.575749 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.576415 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.576415 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.576907 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.576907 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.577411 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.577618 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.577870 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.578229 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.578548 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.578896 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.579225 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.579576 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.579995 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.580165 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 07 08:37:22.580391 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 07 08:37:22.644391 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO dbcounter [None req-e9d0f292-231a-46ec-9b3f-395a325ca737 None None] Registered counter for database nova_api Jun 07 08:37:22.665470 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_db.sqlalchemy.engines [None req-e9d0f292-231a-46ec-9b3f-395a325ca737 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 08:37:22.675754 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writer thread running {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 08:37:22.681499 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: WARNING keystonemiddleware.auth_token [None req-fa1cde0a-66c8-4b30-a108-a89377f26514 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 08:37:22.688734 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: WARNING keystonemiddleware.auth_token [None req-fa1cde0a-66c8-4b30-a108-a89377f26514 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 08:37:22.736982 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.context [None req-e9d0f292-231a-46ec-9b3f-395a325ca737 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),68d8339a-f93e-465c-95c1-304743b93326(cell1) {{(pid=129725) load_cells /opt/stack/nova/nova/context.py:464}} Jun 07 08:37:22.741138 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e9d0f292-231a-46ec-9b3f-395a325ca737 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:37:22.743378 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e9d0f292-231a-46ec-9b3f-395a325ca737 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:37:22.744197 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e9d0f292-231a-46ec-9b3f-395a325ca737 None None] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:37:22.746221 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e9d0f292-231a-46ec-9b3f-395a325ca737 None None] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:37:22.748229 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO dbcounter [None req-e9d0f292-231a-46ec-9b3f-395a325ca737 None None] Registered counter for database nova_cell0 Jun 07 08:37:22.753826 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO dbcounter [None req-e9d0f292-231a-46ec-9b3f-395a325ca737 None None] Registered counter for database nova_cell1 Jun 07 08:37:22.764664 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_db.sqlalchemy.engines [None req-e9d0f292-231a-46ec-9b3f-395a325ca737 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 08:37:22.765994 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_db.sqlalchemy.engines [None req-e9d0f292-231a-46ec-9b3f-395a325ca737 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 08:37:22.775949 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writer thread running {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 08:37:22.776503 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writer thread running {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 08:37:22.917327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: WARNING keystonemiddleware.auth_token [None req-fa1cde0a-66c8-4b30-a108-a89377f26514 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 08:37:22.923330 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: WARNING keystonemiddleware.auth_token [None req-fa1cde0a-66c8-4b30-a108-a89377f26514 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 08:37:22.929669 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e2408b19c0 pid: 129726 (default app) Jun 07 08:37:22.939518 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO dbcounter [None req-e9d0f292-231a-46ec-9b3f-395a325ca737 None None] Registered counter for database nova_cell0 Jun 07 08:37:22.947273 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_db.sqlalchemy.engines [None req-e9d0f292-231a-46ec-9b3f-395a325ca737 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 07 08:37:22.952328 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writer thread running {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 07 08:37:23.386396 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: WARNING keystonemiddleware.auth_token [None req-e9d0f292-231a-46ec-9b3f-395a325ca737 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 08:37:23.393806 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: WARNING keystonemiddleware.auth_token [None req-e9d0f292-231a-46ec-9b3f-395a325ca737 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 08:37:23.616104 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: WARNING keystonemiddleware.auth_token [None req-e9d0f292-231a-46ec-9b3f-395a325ca737 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 07 08:37:23.622487 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: WARNING keystonemiddleware.auth_token [None req-e9d0f292-231a-46ec-9b3f-395a325ca737 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 07 08:37:23.627917 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e2408b19c0 pid: 129725 (default app) Jun 07 08:38:06.530704 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_api:SELECT=3 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:38:06.531607 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell0:SELECT=3 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:38:06.532255 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=3 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:38:06.532912 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell0:SELECT=3 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:38:07.833209 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-a05bf6ee-51d9-42e2-ab57-695eaa43eb9d tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] Action: 'create', calling method: .version_select at 0x7f7fef410700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1033744466"}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:38:10.667969 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_api:SELECT=3 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:38:10.680589 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell0:SELECT=3 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:38:10.683799 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=3 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:38:10.685901 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell0:SELECT=3 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:38:10.760010 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-a05bf6ee-51d9-42e2-ab57-695eaa43eb9d tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.238579 Jun 07 08:38:10.762618 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 1/1] 10.222.0.17 () {60 vars in 1154 bytes} [Tue Jun 7 08:38:06 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4243 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 07 08:38:10.797934 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-18c48430-d72c-4a71-b7da-f304ae2bbe3a tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] Calling method '.version_select at 0x7f7fef2da670>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:11.016337 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-18c48430-d72c-4a71-b7da-f304ae2bbe3a tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/95006bd1-bda3-4e1e-8c2a-814e631d2110" status: 200 len: 345 microversion: 2.1 time: 0.235361 Jun 07 08:38:11.016337 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 2/2] 10.222.0.17 () {58 vars in 1244 bytes} [Tue Jun 7 08:38:10 2022] GET /compute/v2.1/os-volumes/95006bd1-bda3-4e1e-8c2a-814e631d2110 => generated 345 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:38:11.604761 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-af7efd11-64e6-4f21-8e3c-a66f20007f9d tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1810096246", "imageRef": "c04b0a92-7675-47c3-bcc2-8a2a59b997c3", "flavorRef": "452", "networks": [{"uuid": "b77a1b33-6723-495e-a60b-25a8ac4ace08"}]}} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:38:11.777438 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-62246aab-9eb8-47d3-83cf-031afc038196 tempest-VolumesTestJSON-947511888 tempest-VolumesTestJSON-947511888-project] Calling method '.version_select at 0x7f7fef2da790>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:11.958994 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-62246aab-9eb8-47d3-83cf-031afc038196 tempest-VolumesTestJSON-947511888 tempest-VolumesTestJSON-947511888-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/01c9fe71-cb09-4ea2-9d18-330e206c0d69" status: 200 len: 349 microversion: 2.1 time: 0.193032 Jun 07 08:38:11.959858 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 3/3] 10.222.0.17 () {58 vars in 1244 bytes} [Tue Jun 7 08:38:11 2022] GET /compute/v2.1/os-volumes/01c9fe71-cb09-4ea2-9d18-330e206c0d69 => generated 349 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:38:12.025351 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-74e20cbb-ac5b-47e6-a5c7-400a0e8166cb tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] Calling method '.version_select at 0x7f7fef2dae50>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:12.100853 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.network.neutron [None req-af7efd11-64e6-4f21-8e3c-a66f20007f9d tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] validate_networks() for [('b77a1b33-6723-495e-a60b-25a8ac4ace08', None, None, None, None, None)] {{(pid=129725) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 08:38:12.305235 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-74e20cbb-ac5b-47e6-a5c7-400a0e8166cb tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/95006bd1-bda3-4e1e-8c2a-814e631d2110" status: 200 len: 346 microversion: 2.1 time: 0.283583 Jun 07 08:38:12.306857 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 4/4] 10.222.0.17 () {58 vars in 1244 bytes} [Tue Jun 7 08:38:12 2022] GET /compute/v2.1/os-volumes/95006bd1-bda3-4e1e-8c2a-814e631d2110 => generated 346 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:38:12.318969 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-44b52493-cc62-4690-8681-04930db44346 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] Action: 'create', calling method: .version_select at 0x7f7fef2e94c0>, body: {"snapshot": {"volume_id": "95006bd1-bda3-4e1e-8c2a-814e631d2110", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-622631378"}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:38:13.162160 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-44b52493-cc62-4690-8681-04930db44346 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] 10.222.0.17 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.847567 Jun 07 08:38:13.169645 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 5/5] 10.222.0.17 () {60 vars in 1161 bytes} [Tue Jun 7 08:38:12 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:38:13.174346 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-d87b42cd-4c8c-4e31-b027-3527691032c2 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] Calling method '.version_select at 0x7f7fef2dad30>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:13.345321 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-d87b42cd-4c8c-4e31-b027-3527691032c2 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/95965dd6-91df-46f6-9e52-5a47700e83bb" status: 200 len: 286 microversion: 2.1 time: 0.170947 Jun 07 08:38:13.352935 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 6/6] 10.222.0.17 () {58 vars in 1250 bytes} [Tue Jun 7 08:38:13 2022] GET /compute/v2.1/os-snapshots/95965dd6-91df-46f6-9e52-5a47700e83bb => generated 286 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:38:13.367473 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-426f87e0-eaa1-4707-91dc-10d744ad144b tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] Calling method '.version_select at 0x7f7fef2da9d0>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:13.514460 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-426f87e0-eaa1-4707-91dc-10d744ad144b tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.159991 Jun 07 08:38:13.525399 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 7/7] 10.222.0.17 () {58 vars in 1139 bytes} [Tue Jun 7 08:38:13 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:38:13.532273 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-b19be303-291d-4c8a-ab2e-b232a6abeb26 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] Calling method '.version_select at 0x7f7fef2e91f0>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:13.607891 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-b19be303-291d-4c8a-ab2e-b232a6abeb26 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/95965dd6-91df-46f6-9e52-5a47700e83bb" status: 200 len: 286 microversion: 2.1 time: 0.080981 Jun 07 08:38:13.608811 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 8/8] 10.222.0.17 () {58 vars in 1250 bytes} [Tue Jun 7 08:38:13 2022] GET /compute/v2.1/os-snapshots/95965dd6-91df-46f6-9e52-5a47700e83bb => generated 286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:38:14.002886 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-af7efd11-64e6-4f21-8e3c-a66f20007f9d tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Flavor limits 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 08:38:14.003431 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-af7efd11-64e6-4f21-8e3c-a66f20007f9d tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Image limits 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 08:38:14.004041 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-af7efd11-64e6-4f21-8e3c-a66f20007f9d tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Flavor pref 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 08:38:14.004573 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-af7efd11-64e6-4f21-8e3c-a66f20007f9d tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Image pref 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 08:38:14.005162 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-af7efd11-64e6-4f21-8e3c-a66f20007f9d tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 08:38:14.032806 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-af7efd11-64e6-4f21-8e3c-a66f20007f9d tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:14.033927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-af7efd11-64e6-4f21-8e3c-a66f20007f9d tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:14.036455 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-af7efd11-64e6-4f21-8e3c-a66f20007f9d tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:14.038294 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-af7efd11-64e6-4f21-8e3c-a66f20007f9d tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:14.114549 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.quota [None req-af7efd11-64e6-4f21-8e3c-a66f20007f9d tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Getting quotas for project f26ee9298ae04230979b6a62d24be0e1. Resources: {'ram', 'cores', 'instances'} {{(pid=129725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 08:38:14.120355 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-6c54af42-c52c-43b9-a697-79632acef34f tempest-VolumesTestJSON-947511888 tempest-VolumesTestJSON-947511888-project] Calling method '.version_select at 0x7f7fef2e93a0>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:14.148045 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.quota [None req-af7efd11-64e6-4f21-8e3c-a66f20007f9d tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Getting quotas for user ae58168dadc845daa0958cf975a41abd and project f26ee9298ae04230979b6a62d24be0e1. Resources: {'ram', 'cores', 'instances'} {{(pid=129725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 08:38:14.171713 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-af7efd11-64e6-4f21-8e3c-a66f20007f9d tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Going to run 1 instances... {{(pid=129725) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 08:38:14.176109 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-af7efd11-64e6-4f21-8e3c-a66f20007f9d tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c04b0a92-7675-47c3-bcc2-8a2a59b997c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 08:38:14.225875 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-6c54af42-c52c-43b9-a697-79632acef34f tempest-VolumesTestJSON-947511888 tempest-VolumesTestJSON-947511888-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/96605657-020f-4bf3-9cdd-34dc30a26b0f" status: 200 len: 351 microversion: 2.1 time: 0.109638 Jun 07 08:38:14.232109 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 9/9] 10.222.0.17 () {58 vars in 1244 bytes} [Tue Jun 7 08:38:14 2022] GET /compute/v2.1/os-volumes/96605657-020f-4bf3-9cdd-34dc30a26b0f => generated 351 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:38:14.384643 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-af7efd11-64e6-4f21-8e3c-a66f20007f9d tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.737555 Jun 07 08:38:14.395690 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 1/10] 10.222.0.17 () {60 vars in 1146 bytes} [Tue Jun 7 08:38:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 08:38:14.402034 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-4b4ffbd4-1a51-4473-be7a-8d8c87922fbc tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:14.403162 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-4b4ffbd4-1a51-4473-be7a-8d8c87922fbc tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:14.622900 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-8bece35a-cf94-4ae9-b823-4eab5bfa1fe8 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] Calling method '.version_select at 0x7f7feea105e0>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:14.670820 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-4b4ffbd4-1a51-4473-be7a-8d8c87922fbc tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae58168dadc845daa0958cf975a41abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ee9298ae04230979b6a62d24be0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:14.705293 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-4b4ffbd4-1a51-4473-be7a-8d8c87922fbc tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77" status: 200 len: 1215 microversion: 2.1 time: 0.308685 Jun 07 08:38:14.708303 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 10/11] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:14 2022] GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 => generated 1215 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:14.759051 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-8bece35a-cf94-4ae9-b823-4eab5bfa1fe8 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/95965dd6-91df-46f6-9e52-5a47700e83bb" status: 200 len: 286 microversion: 2.1 time: 0.142659 Jun 07 08:38:14.760110 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 2/12] 10.222.0.17 () {58 vars in 1250 bytes} [Tue Jun 7 08:38:14 2022] GET /compute/v2.1/os-snapshots/95965dd6-91df-46f6-9e52-5a47700e83bb => generated 286 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:38:15.724671 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-8459f5d2-d517-4fee-995f-c21a689d2768 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:15.725342 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-8459f5d2-d517-4fee-995f-c21a689d2768 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:15.782056 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-96e6c919-3e12-4234-b928-14d7ca26d901 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] Calling method '.version_select at 0x7f7fee1f6f70>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:15.847672 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-8459f5d2-d517-4fee-995f-c21a689d2768 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae58168dadc845daa0958cf975a41abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ee9298ae04230979b6a62d24be0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:15.861058 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-8459f5d2-d517-4fee-995f-c21a689d2768 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77" status: 200 len: 1215 microversion: 2.1 time: 0.138691 Jun 07 08:38:15.862740 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 11/13] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:15 2022] GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 => generated 1215 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:15.865431 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-96e6c919-3e12-4234-b928-14d7ca26d901 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/95965dd6-91df-46f6-9e52-5a47700e83bb" status: 200 len: 286 microversion: 2.1 time: 0.097460 Jun 07 08:38:15.867425 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 3/14] 10.222.0.17 () {58 vars in 1250 bytes} [Tue Jun 7 08:38:15 2022] GET /compute/v2.1/os-snapshots/95965dd6-91df-46f6-9e52-5a47700e83bb => generated 286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:38:16.881481 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-1c4bd66f-9e39-468b-ac66-10065a8945ee tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] Calling method '.version_select at 0x7f7fef2be820>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:16.886252 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-79308f74-04c7-4c71-b218-e55c60869498 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:16.887808 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-79308f74-04c7-4c71-b218-e55c60869498 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:16.937295 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-1c4bd66f-9e39-468b-ac66-10065a8945ee tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/95965dd6-91df-46f6-9e52-5a47700e83bb" status: 200 len: 286 microversion: 2.1 time: 0.061249 Jun 07 08:38:16.937879 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 12/15] 10.222.0.17 () {58 vars in 1250 bytes} [Tue Jun 7 08:38:16 2022] GET /compute/v2.1/os-snapshots/95965dd6-91df-46f6-9e52-5a47700e83bb => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:38:17.084779 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-79308f74-04c7-4c71-b218-e55c60869498 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae58168dadc845daa0958cf975a41abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ee9298ae04230979b6a62d24be0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:17.118682 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-79308f74-04c7-4c71-b218-e55c60869498 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77" status: 200 len: 1215 microversion: 2.1 time: 0.239824 Jun 07 08:38:17.120114 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 4/16] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:16 2022] GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 => generated 1215 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:17.464614 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-61add12b-6dbf-4f64-af8a-6eadfaccf5bc tempest-VolumesTestJSON-947511888 tempest-VolumesTestJSON-947511888-project] Calling method '.version_select at 0x7f7fef250040>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:17.617405 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-61add12b-6dbf-4f64-af8a-6eadfaccf5bc tempest-VolumesTestJSON-947511888 tempest-VolumesTestJSON-947511888-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/16806e31-d0bc-4d0a-bbcb-e5e5db0d511c" status: 200 len: 351 microversion: 2.1 time: 0.159664 Jun 07 08:38:17.618230 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 13/17] 10.222.0.17 () {58 vars in 1244 bytes} [Tue Jun 7 08:38:17 2022] GET /compute/v2.1/os-volumes/16806e31-d0bc-4d0a-bbcb-e5e5db0d511c => generated 351 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:38:17.630825 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-ebe9af1c-c694-4595-8b4c-989c7269e1b4 tempest-VolumesTestJSON-947511888 tempest-VolumesTestJSON-947511888-project] Calling method '.version_select at 0x7f7fee195670>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:17.843807 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-ebe9af1c-c694-4595-8b4c-989c7269e1b4 tempest-VolumesTestJSON-947511888 tempest-VolumesTestJSON-947511888-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.216978 Jun 07 08:38:17.845013 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 5/18] 10.222.0.17 () {58 vars in 1133 bytes} [Tue Jun 7 08:38:17 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:17.859020 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-5d5a9a9b-94c9-4b89-a782-5d527e8c77cc tempest-VolumesTestJSON-947511888 tempest-VolumesTestJSON-947511888-project] Calling method '.version_select at 0x7f7fef2bec10>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:17.949783 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-d845cc56-11e8-4eac-8671-4b504dffa8ad tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] Calling method '.version_select at 0x7f7fee195d30>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:18.068721 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-5d5a9a9b-94c9-4b89-a782-5d527e8c77cc tempest-VolumesTestJSON-947511888 tempest-VolumesTestJSON-947511888-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.214273 Jun 07 08:38:18.076409 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-d845cc56-11e8-4eac-8671-4b504dffa8ad tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/95965dd6-91df-46f6-9e52-5a47700e83bb" status: 200 len: 287 microversion: 2.1 time: 0.122912 Jun 07 08:38:18.076409 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 6/19] 10.222.0.17 () {58 vars in 1250 bytes} [Tue Jun 7 08:38:17 2022] GET /compute/v2.1/os-snapshots/95965dd6-91df-46f6-9e52-5a47700e83bb => generated 287 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:38:18.077429 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 14/20] 10.222.0.17 () {58 vars in 1148 bytes} [Tue Jun 7 08:38:17 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:38:18.081190 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-a6dd9e2a-ca85-44fd-83cf-8eaf005ba567 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] Calling method '.version_select at 0x7f7fee1a4430>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:18.081607 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-755f403f-a6fe-48cd-93a3-8f6fc0e12c80 tempest-VolumesTestJSON-947511888 tempest-VolumesTestJSON-947511888-project] Calling method '.version_select at 0x7f7fef2e9e50>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:18.259885 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-755f403f-a6fe-48cd-93a3-8f6fc0e12c80 tempest-VolumesTestJSON-947511888 tempest-VolumesTestJSON-947511888-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.181801 Jun 07 08:38:18.266841 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 15/21] 10.222.0.17 () {58 vars in 1133 bytes} [Tue Jun 7 08:38:18 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:18.272814 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-a663637c-f781-4aa0-be79-b4a4072bdbb6 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:18.272814 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-a663637c-f781-4aa0-be79-b4a4072bdbb6 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:18.280279 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a663637c-f781-4aa0-be79-b4a4072bdbb6 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:18.280730 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a663637c-f781-4aa0-be79-b4a4072bdbb6 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:18.283713 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a663637c-f781-4aa0-be79-b4a4072bdbb6 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:18.284160 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a663637c-f781-4aa0-be79-b4a4072bdbb6 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:18.515239 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-a6dd9e2a-ca85-44fd-83cf-8eaf005ba567 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] 10.222.0.17 "DELETE /compute/v2.1/os-snapshots/95965dd6-91df-46f6-9e52-5a47700e83bb" status: 202 len: 0 microversion: 2.1 time: 0.438465 Jun 07 08:38:18.515902 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 7/22] 10.222.0.17 () {58 vars in 1253 bytes} [Tue Jun 7 08:38:18 2022] DELETE /compute/v2.1/os-snapshots/95965dd6-91df-46f6-9e52-5a47700e83bb => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 08:38:18.524888 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-45744e7d-db0c-4b41-9536-42ee3693aca0 tempest-VolumesTestJSON-947511888 tempest-VolumesTestJSON-947511888-project] Calling method '.version_select at 0x7f7fee1a4dc0>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:18.659866 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-a663637c-f781-4aa0-be79-b4a4072bdbb6 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae58168dadc845daa0958cf975a41abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ee9298ae04230979b6a62d24be0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:18.675374 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-a663637c-f781-4aa0-be79-b4a4072bdbb6 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77" status: 200 len: 1211 microversion: 2.1 time: 0.413323 Jun 07 08:38:18.688881 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 16/23] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:18 2022] GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 => generated 1211 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:18.701837 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-45744e7d-db0c-4b41-9536-42ee3693aca0 tempest-VolumesTestJSON-947511888 tempest-VolumesTestJSON-947511888-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.184018 Jun 07 08:38:18.702571 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 8/24] 10.222.0.17 () {58 vars in 1166 bytes} [Tue Jun 7 08:38:18 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:38:18.713950 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-d127a657-6bc0-448c-afa7-e09ab88cb338 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] Calling method '.version_select at 0x7f7fee1a4a60>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:18.789750 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-d127a657-6bc0-448c-afa7-e09ab88cb338 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/95965dd6-91df-46f6-9e52-5a47700e83bb" status: 200 len: 286 microversion: 2.1 time: 0.085759 Jun 07 08:38:18.790724 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 9/25] 10.222.0.17 () {58 vars in 1250 bytes} [Tue Jun 7 08:38:18 2022] GET /compute/v2.1/os-snapshots/95965dd6-91df-46f6-9e52-5a47700e83bb => generated 286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:38:18.795968 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-e2e5bce0-1b4a-4562-ada0-f7cd940755f2 tempest-VolumesTestJSON-947511888 tempest-VolumesTestJSON-947511888-project] Calling method '.version_select at 0x7f7fee1a4820>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:18.967040 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-425a1db4-cb26-42df-ab07-dc97324f7727 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-424404791", "imageRef": "c04b0a92-7675-47c3-bcc2-8a2a59b997c3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:38:19.031144 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-e2e5bce0-1b4a-4562-ada0-f7cd940755f2 tempest-VolumesTestJSON-947511888 tempest-VolumesTestJSON-947511888-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.238887 Jun 07 08:38:19.031750 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 10/26] 10.222.0.17 () {58 vars in 1169 bytes} [Tue Jun 7 08:38:18 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:38:19.046470 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-f3756d47-4dab-42de-84c7-8e4745c7d5bf tempest-VolumesTestJSON-947511888 tempest-VolumesTestJSON-947511888-project] Calling method '.version_select at 0x7f7fee1b1430>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:19.268227 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.network.neutron [None req-425a1db4-cb26-42df-ab07-dc97324f7727 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] validate_networks() for [('5db4407e-2ca4-47e4-aa62-77735c5013d3', None, None, None, None, None)] {{(pid=129726) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 08:38:19.308968 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-f3756d47-4dab-42de-84c7-8e4745c7d5bf tempest-VolumesTestJSON-947511888 tempest-VolumesTestJSON-947511888-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.257009 Jun 07 08:38:19.308968 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 11/27] 10.222.0.17 () {58 vars in 1154 bytes} [Tue Jun 7 08:38:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:19.326370 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-dad8cba9-110e-499a-b6b1-1f063aed0076 tempest-VolumesTestJSON-947511888 tempest-VolumesTestJSON-947511888-project] Calling method '.version_select at 0x7f7fee195310>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:19.561180 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-dad8cba9-110e-499a-b6b1-1f063aed0076 tempest-VolumesTestJSON-947511888 tempest-VolumesTestJSON-947511888-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.251334 Jun 07 08:38:19.562320 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 12/28] 10.222.0.17 () {58 vars in 1187 bytes} [Tue Jun 7 08:38:19 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:38:19.574078 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-f1c7ad1a-3145-4557-8037-97c0d06ea4c1 tempest-VolumesTestJSON-947511888 tempest-VolumesTestJSON-947511888-project] Calling method '.version_select at 0x7f7fee1a4af0>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:19.787528 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-f1c7ad1a-3145-4557-8037-97c0d06ea4c1 tempest-VolumesTestJSON-947511888 tempest-VolumesTestJSON-947511888-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.217695 Jun 07 08:38:19.788861 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 13/29] 10.222.0.17 () {58 vars in 1154 bytes} [Tue Jun 7 08:38:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:19.795642 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-50bb9bac-e3a5-493d-b92c-cc1a50a7e26b tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:19.797216 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-50bb9bac-e3a5-493d-b92c-cc1a50a7e26b tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:19.811271 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-50bb9bac-e3a5-493d-b92c-cc1a50a7e26b tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:19.812301 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-50bb9bac-e3a5-493d-b92c-cc1a50a7e26b tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:19.814621 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-50bb9bac-e3a5-493d-b92c-cc1a50a7e26b tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:19.817715 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-50bb9bac-e3a5-493d-b92c-cc1a50a7e26b tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:20.194816 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-50bb9bac-e3a5-493d-b92c-cc1a50a7e26b tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae58168dadc845daa0958cf975a41abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ee9298ae04230979b6a62d24be0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:20.219515 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-50bb9bac-e3a5-493d-b92c-cc1a50a7e26b tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77" status: 200 len: 1273 microversion: 2.1 time: 0.424246 Jun 07 08:38:20.220232 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 14/30] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:19 2022] GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 => generated 1273 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:20.237117 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-f237b943-9308-43df-8761-a4591f2aceb8 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] Calling method '.version_select at 0x7f7fee1b13a0>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:20.325917 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.wsgi [None req-f237b943-9308-43df-8761-a4591f2aceb8 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] HTTP exception thrown: Snapshot 95965dd6-91df-46f6-9e52-5a47700e83bb could not be found. Jun 07 08:38:20.329686 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-f237b943-9308-43df-8761-a4591f2aceb8 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] Request method failure captured: Jun 07 08:38:20.329686 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: request: GET /compute/v2.1/os-snapshots/95965dd6-91df-46f6-9e52-5a47700e83bb HTTP/1.1 Jun 07 08:38:20.329686 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept: application/json Jun 07 08:38:20.329686 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept-Encoding: identity Jun 07 08:38:20.329686 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Connection: close Jun 07 08:38:20.329686 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Length: 0 Jun 07 08:38:20.329686 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Type: application/json Jun 07 08:38:20.329686 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Host: 10.222.0.17 Jun 07 08:38:20.329686 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Openstack-System-Scope: None Jun 07 08:38:20.329686 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: User-Agent: python-urllib3/1.26.9 Jun 07 08:38:20.329686 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Auth-Token: gAAAAABinw5urbMKoh0O4j3qrbPRQU2kdwkUjuZ-O2Avc4IEXXyfWfJpjOybybjtO1Gvgv8YlScCJP913Sazgpy19nCgD1h8zdXGlhQfxwsnjZk2CL4EvqU0SMbtnVcyRrLB4rogPjK6ltjQ0BY28mcjeMN-WtlNcNPwpip9_LNqkL-UwoCVmAQ Jun 07 08:38:20.329686 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Id: None Jun 07 08:38:20.329686 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Name: None Jun 07 08:38:20.329686 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Identity-Status: Confirmed Jun 07 08:38:20.329686 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Is-Admin-Project: True Jun 07 08:38:20.329686 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Id: default Jun 07 08:38:20.329686 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Name: Default Jun 07 08:38:20.329686 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Id: f0e5af0d10f448bdad3536aded64709a Jun 07 08:38:20.329686 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-537365179 Jun 07 08:38:20.329686 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Role: reader,member Jun 07 08:38:20.329686 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Roles: reader,member Jun 07 08:38:20.330751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f0e5af0d10f448bdad3536aded64709a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f0e5af0d10f448bdad3536aded64709a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f0e5af0d10f448bdad3536aded64709a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f0e5af0d10f448bdad3536aded64709a"}]}] Jun 07 08:38:20.330751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant: tempest-VolumesSnapshotsTestJSON-537365179 Jun 07 08:38:20.330751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Id: f0e5af0d10f448bdad3536aded64709a Jun 07 08:38:20.330751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-537365179 Jun 07 08:38:20.330751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User: tempest-VolumesSnapshotsTestJSON-537365179-project Jun 07 08:38:20.330751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Id: default Jun 07 08:38:20.330751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Name: Default Jun 07 08:38:20.330751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Id: 89b9c8a15aee4129a24abd82eaa54c05 Jun 07 08:38:20.330751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Name: tempest-VolumesSnapshotsTestJSON-537365179-project Jun 07 08:38:20.330751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: method: Jun 07 08:38:20.330751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: exception: Snapshot 95965dd6-91df-46f6-9e52-5a47700e83bb could not be found. Jun 07 08:38:20.330751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: action_args: {'id': '95965dd6-91df-46f6-9e52-5a47700e83bb'} Jun 07 08:38:20.330751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:38:20.331380 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:20.331380 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 07 08:38:20.331380 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 07 08:38:20.331380 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 07 08:38:20.331380 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 07 08:38:20.331380 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 07 08:38:20.331380 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 07 08:38:20.331380 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 08:38:20.331380 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 08:38:20.331380 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 08:38:20.331380 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 08:38:20.331380 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 08:38:20.331380 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 08:38:20.331380 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 08:38:20.331380 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 08:38:20.331380 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 95965dd6-91df-46f6-9e52-5a47700e83bb could not be found. (HTTP 404) (Request-ID: req-25be0a62-c377-4505-a3bc-673a7f743eec) Jun 07 08:38:20.331380 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:20.331380 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:38:20.332322 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:20.332322 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:20.332322 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 07 08:38:20.332322 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 07 08:38:20.332322 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 08:38:20.332322 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 08:38:20.332322 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 07 08:38:20.332322 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 07 08:38:20.332322 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 08:38:20.332322 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 08:38:20.332322 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 07 08:38:20.332322 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 07 08:38:20.332322 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 07 08:38:20.332322 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 07 08:38:20.332322 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 07 08:38:20.332322 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 07 08:38:20.332322 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 08:38:20.332322 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 08:38:20.332322 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 08:38:20.333213 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 08:38:20.333213 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 08:38:20.333213 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 08:38:20.333213 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 08:38:20.333213 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 08:38:20.333213 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 95965dd6-91df-46f6-9e52-5a47700e83bb could not be found. Jun 07 08:38:20.333213 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:20.333213 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:38:20.333213 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:20.333213 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:20.333213 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:38:20.333213 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:38:20.333213 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:38:20.333213 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:38:20.333213 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 08:38:20.333213 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 08:38:20.333213 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:38:20.333213 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:38:20.333213 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 07 08:38:20.333213 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:38:20.334124 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 95965dd6-91df-46f6-9e52-5a47700e83bb could not be found. Jun 07 08:38:20.334124 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:20.334124 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:38:20.334124 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:20.334124 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:20.334124 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:38:20.334124 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:38:20.334124 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:38:20.334124 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:38:20.334124 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 95965dd6-91df-46f6-9e52-5a47700e83bb could not be found. Jun 07 08:38:20.334124 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:20.334124 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-f237b943-9308-43df-8761-a4591f2aceb8 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] Returning 404 to user: Snapshot 95965dd6-91df-46f6-9e52-5a47700e83bb could not be found. {{(pid=129725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:38:20.334124 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-f237b943-9308-43df-8761-a4591f2aceb8 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/95965dd6-91df-46f6-9e52-5a47700e83bb" status: 404 len: 111 microversion: 2.1 time: 0.106860 Jun 07 08:38:20.337488 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 15/31] 10.222.0.17 () {58 vars in 1250 bytes} [Tue Jun 7 08:38:20 2022] GET /compute/v2.1/os-snapshots/95965dd6-91df-46f6-9e52-5a47700e83bb => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:38:20.358879 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-aece15a3-e5d2-411e-b4ce-a06222b6e525 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] Calling method '.version_select at 0x7f7fefcc08b0>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:20.712614 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-aece15a3-e5d2-411e-b4ce-a06222b6e525 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/95006bd1-bda3-4e1e-8c2a-814e631d2110" status: 202 len: 0 microversion: 2.1 time: 0.372663 Jun 07 08:38:20.713025 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 16/32] 10.222.0.17 () {58 vars in 1247 bytes} [Tue Jun 7 08:38:20 2022] DELETE /compute/v2.1/os-volumes/95006bd1-bda3-4e1e-8c2a-814e631d2110 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 08:38:20.740148 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-c78d72e2-a2ff-4eb0-99c4-3c2f708eeb28 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] Calling method '.version_select at 0x7f7fee0b83a0>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:20.833322 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-c78d72e2-a2ff-4eb0-99c4-3c2f708eeb28 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/95006bd1-bda3-4e1e-8c2a-814e631d2110" status: 200 len: 345 microversion: 2.1 time: 0.115192 Jun 07 08:38:20.841763 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 17/33] 10.222.0.17 () {58 vars in 1244 bytes} [Tue Jun 7 08:38:20 2022] GET /compute/v2.1/os-volumes/95006bd1-bda3-4e1e-8c2a-814e631d2110 => generated 345 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:38:21.237814 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-faa73eaf-804d-4f4f-ad7a-d6a00addc29e tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:21.239131 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-faa73eaf-804d-4f4f-ad7a-d6a00addc29e tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:21.248824 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-faa73eaf-804d-4f4f-ad7a-d6a00addc29e tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:21.251514 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-faa73eaf-804d-4f4f-ad7a-d6a00addc29e tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:21.252184 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-faa73eaf-804d-4f4f-ad7a-d6a00addc29e tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:21.252726 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-faa73eaf-804d-4f4f-ad7a-d6a00addc29e tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:21.511513 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-faa73eaf-804d-4f4f-ad7a-d6a00addc29e tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae58168dadc845daa0958cf975a41abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ee9298ae04230979b6a62d24be0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:21.529456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-faa73eaf-804d-4f4f-ad7a-d6a00addc29e tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77" status: 200 len: 1273 microversion: 2.1 time: 0.286962 Jun 07 08:38:21.537066 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 18/34] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:21 2022] GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 => generated 1273 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:38:21.853516 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-74a862b6-a08f-458d-9f93-19978ead9136 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] Calling method '.version_select at 0x7f7fee1f6f70>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:21.924938 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.wsgi [None req-74a862b6-a08f-458d-9f93-19978ead9136 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] HTTP exception thrown: Volume 95006bd1-bda3-4e1e-8c2a-814e631d2110 could not be found. Jun 07 08:38:21.927491 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-74a862b6-a08f-458d-9f93-19978ead9136 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] Request method failure captured: Jun 07 08:38:21.927491 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: request: GET /compute/v2.1/os-volumes/95006bd1-bda3-4e1e-8c2a-814e631d2110 HTTP/1.1 Jun 07 08:38:21.927491 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept: application/json Jun 07 08:38:21.927491 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept-Encoding: identity Jun 07 08:38:21.927491 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Connection: close Jun 07 08:38:21.927491 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Length: 0 Jun 07 08:38:21.927491 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Type: application/json Jun 07 08:38:21.927491 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Host: 10.222.0.17 Jun 07 08:38:21.927491 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Openstack-System-Scope: None Jun 07 08:38:21.927491 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: User-Agent: python-urllib3/1.26.9 Jun 07 08:38:21.927491 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Auth-Token: gAAAAABinw5urbMKoh0O4j3qrbPRQU2kdwkUjuZ-O2Avc4IEXXyfWfJpjOybybjtO1Gvgv8YlScCJP913Sazgpy19nCgD1h8zdXGlhQfxwsnjZk2CL4EvqU0SMbtnVcyRrLB4rogPjK6ltjQ0BY28mcjeMN-WtlNcNPwpip9_LNqkL-UwoCVmAQ Jun 07 08:38:21.927491 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Id: None Jun 07 08:38:21.927491 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Name: None Jun 07 08:38:21.927491 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Identity-Status: Confirmed Jun 07 08:38:21.927491 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Is-Admin-Project: True Jun 07 08:38:21.927491 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Id: default Jun 07 08:38:21.927491 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Name: Default Jun 07 08:38:21.927491 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Id: f0e5af0d10f448bdad3536aded64709a Jun 07 08:38:21.927491 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-537365179 Jun 07 08:38:21.927491 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Role: reader,member Jun 07 08:38:21.927491 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Roles: reader,member Jun 07 08:38:21.928538 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f0e5af0d10f448bdad3536aded64709a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f0e5af0d10f448bdad3536aded64709a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f0e5af0d10f448bdad3536aded64709a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f0e5af0d10f448bdad3536aded64709a"}]}] Jun 07 08:38:21.928538 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant: tempest-VolumesSnapshotsTestJSON-537365179 Jun 07 08:38:21.928538 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Id: f0e5af0d10f448bdad3536aded64709a Jun 07 08:38:21.928538 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-537365179 Jun 07 08:38:21.928538 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User: tempest-VolumesSnapshotsTestJSON-537365179-project Jun 07 08:38:21.928538 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Id: default Jun 07 08:38:21.928538 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Name: Default Jun 07 08:38:21.928538 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Id: 89b9c8a15aee4129a24abd82eaa54c05 Jun 07 08:38:21.928538 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Name: tempest-VolumesSnapshotsTestJSON-537365179-project Jun 07 08:38:21.928538 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: method: Jun 07 08:38:21.928538 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: exception: Volume 95006bd1-bda3-4e1e-8c2a-814e631d2110 could not be found. Jun 07 08:38:21.928538 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: action_args: {'id': '95006bd1-bda3-4e1e-8c2a-814e631d2110'} Jun 07 08:38:21.928538 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:38:21.929958 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:21.929958 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 08:38:21.929958 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 08:38:21.929958 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 08:38:21.929958 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 08:38:21.929958 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 08:38:21.929958 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 08:38:21.929958 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 08:38:21.929958 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 08:38:21.929958 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 08:38:21.929958 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 08:38:21.929958 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 08:38:21.929958 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 08:38:21.929958 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 08:38:21.929958 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 08:38:21.929958 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 95006bd1-bda3-4e1e-8c2a-814e631d2110 could not be found. (HTTP 404) (Request-ID: req-3643b028-4798-404d-b35c-80ff7700bb5d) Jun 07 08:38:21.929958 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:21.929958 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:38:21.929958 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:21.931194 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:21.931194 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 08:38:21.931194 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 08:38:21.931194 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 08:38:21.931194 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 08:38:21.931194 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 08:38:21.931194 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 08:38:21.931194 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 08:38:21.931194 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 08:38:21.931194 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 08:38:21.931194 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 08:38:21.931194 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 08:38:21.931194 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 08:38:21.931194 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 08:38:21.931194 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 08:38:21.931194 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 08:38:21.931194 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 08:38:21.931194 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 08:38:21.931194 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 08:38:21.933338 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 08:38:21.933338 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 08:38:21.933338 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 08:38:21.933338 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 08:38:21.933338 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 95006bd1-bda3-4e1e-8c2a-814e631d2110 could not be found. Jun 07 08:38:21.933338 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:21.933338 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:38:21.933338 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:21.933338 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:21.933338 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:38:21.933338 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:38:21.933338 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:38:21.933338 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:38:21.933338 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 08:38:21.933338 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 08:38:21.933338 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:38:21.933338 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:38:21.933338 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 08:38:21.933338 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:38:21.935307 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 95006bd1-bda3-4e1e-8c2a-814e631d2110 could not be found. Jun 07 08:38:21.935307 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:21.935307 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:38:21.935307 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:21.935307 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:21.935307 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:38:21.935307 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:38:21.935307 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:38:21.935307 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:38:21.935307 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 95006bd1-bda3-4e1e-8c2a-814e631d2110 could not be found. Jun 07 08:38:21.935307 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:21.935307 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-74a862b6-a08f-458d-9f93-19978ead9136 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] Returning 404 to user: Volume 95006bd1-bda3-4e1e-8c2a-814e631d2110 could not be found. {{(pid=129725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:38:21.935307 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-74a862b6-a08f-458d-9f93-19978ead9136 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/95006bd1-bda3-4e1e-8c2a-814e631d2110" status: 404 len: 109 microversion: 2.1 time: 0.083544 Jun 07 08:38:21.935307 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 19/35] 10.222.0.17 () {58 vars in 1244 bytes} [Tue Jun 7 08:38:21 2022] GET /compute/v2.1/os-volumes/95006bd1-bda3-4e1e-8c2a-814e631d2110 => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 08:38:21.956701 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-f10b244b-4dc8-4f64-98ff-a08d8dbec9d4 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] Calling method '.version_select at 0x7f7fee1341f0>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:22.058431 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.wsgi [None req-f10b244b-4dc8-4f64-98ff-a08d8dbec9d4 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] HTTP exception thrown: Volume 95006bd1-bda3-4e1e-8c2a-814e631d2110 could not be found. Jun 07 08:38:22.062433 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-f10b244b-4dc8-4f64-98ff-a08d8dbec9d4 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] Request method failure captured: Jun 07 08:38:22.062433 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: request: DELETE /compute/v2.1/os-volumes/95006bd1-bda3-4e1e-8c2a-814e631d2110 HTTP/1.1 Jun 07 08:38:22.062433 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept: application/json Jun 07 08:38:22.062433 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept-Encoding: identity Jun 07 08:38:22.062433 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Connection: close Jun 07 08:38:22.062433 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Length: 0 Jun 07 08:38:22.062433 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Type: application/json Jun 07 08:38:22.062433 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Host: 10.222.0.17 Jun 07 08:38:22.062433 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Openstack-System-Scope: None Jun 07 08:38:22.062433 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: User-Agent: python-urllib3/1.26.9 Jun 07 08:38:22.062433 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Auth-Token: gAAAAABinw5urbMKoh0O4j3qrbPRQU2kdwkUjuZ-O2Avc4IEXXyfWfJpjOybybjtO1Gvgv8YlScCJP913Sazgpy19nCgD1h8zdXGlhQfxwsnjZk2CL4EvqU0SMbtnVcyRrLB4rogPjK6ltjQ0BY28mcjeMN-WtlNcNPwpip9_LNqkL-UwoCVmAQ Jun 07 08:38:22.062433 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Id: None Jun 07 08:38:22.062433 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Name: None Jun 07 08:38:22.062433 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Identity-Status: Confirmed Jun 07 08:38:22.062433 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Is-Admin-Project: True Jun 07 08:38:22.062433 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Id: default Jun 07 08:38:22.062433 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Name: Default Jun 07 08:38:22.062433 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Id: f0e5af0d10f448bdad3536aded64709a Jun 07 08:38:22.062433 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-537365179 Jun 07 08:38:22.062433 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Role: reader,member Jun 07 08:38:22.062433 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Roles: reader,member Jun 07 08:38:22.066972 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f0e5af0d10f448bdad3536aded64709a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f0e5af0d10f448bdad3536aded64709a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f0e5af0d10f448bdad3536aded64709a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f0e5af0d10f448bdad3536aded64709a"}]}] Jun 07 08:38:22.066972 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant: tempest-VolumesSnapshotsTestJSON-537365179 Jun 07 08:38:22.066972 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Id: f0e5af0d10f448bdad3536aded64709a Jun 07 08:38:22.066972 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-537365179 Jun 07 08:38:22.066972 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User: tempest-VolumesSnapshotsTestJSON-537365179-project Jun 07 08:38:22.066972 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Id: default Jun 07 08:38:22.066972 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Name: Default Jun 07 08:38:22.066972 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Id: 89b9c8a15aee4129a24abd82eaa54c05 Jun 07 08:38:22.066972 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Name: tempest-VolumesSnapshotsTestJSON-537365179-project Jun 07 08:38:22.066972 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: method: Jun 07 08:38:22.066972 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: exception: Volume 95006bd1-bda3-4e1e-8c2a-814e631d2110 could not be found. Jun 07 08:38:22.066972 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: action_args: {'id': '95006bd1-bda3-4e1e-8c2a-814e631d2110'} Jun 07 08:38:22.066972 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:38:22.068562 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:22.068562 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 08:38:22.068562 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 08:38:22.068562 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 08:38:22.068562 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 08:38:22.068562 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 08:38:22.068562 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 08:38:22.068562 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 08:38:22.068562 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 08:38:22.068562 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 08:38:22.068562 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 08:38:22.068562 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 08:38:22.068562 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 08:38:22.068562 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 08:38:22.068562 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 08:38:22.068562 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 95006bd1-bda3-4e1e-8c2a-814e631d2110 could not be found. (HTTP 404) (Request-ID: req-0490b6bf-43c6-4a0e-9309-9dac1aaa12a6) Jun 07 08:38:22.068562 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:22.068562 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:38:22.068562 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:22.070099 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:22.070099 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 07 08:38:22.070099 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 07 08:38:22.070099 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 08:38:22.070099 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 08:38:22.070099 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 08:38:22.070099 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 08:38:22.070099 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 08:38:22.070099 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 08:38:22.070099 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 08:38:22.070099 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 08:38:22.070099 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 08:38:22.070099 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 08:38:22.070099 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 08:38:22.070099 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 08:38:22.070099 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 08:38:22.070099 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 08:38:22.070099 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 08:38:22.070099 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 08:38:22.072140 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 08:38:22.072140 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 08:38:22.072140 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 08:38:22.072140 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 08:38:22.072140 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 95006bd1-bda3-4e1e-8c2a-814e631d2110 could not be found. Jun 07 08:38:22.072140 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:22.072140 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:38:22.072140 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:22.072140 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:22.072140 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:38:22.072140 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:38:22.072140 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:38:22.072140 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:38:22.072140 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 08:38:22.072140 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 08:38:22.072140 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:38:22.072140 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:38:22.072140 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 07 08:38:22.072140 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:38:22.073546 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 95006bd1-bda3-4e1e-8c2a-814e631d2110 could not be found. Jun 07 08:38:22.073546 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:22.073546 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:38:22.073546 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:22.073546 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:22.073546 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:38:22.073546 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:38:22.073546 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:38:22.073546 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:38:22.073546 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 95006bd1-bda3-4e1e-8c2a-814e631d2110 could not be found. Jun 07 08:38:22.073546 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:22.073546 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-f10b244b-4dc8-4f64-98ff-a08d8dbec9d4 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] Returning 404 to user: Volume 95006bd1-bda3-4e1e-8c2a-814e631d2110 could not be found. {{(pid=129725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:38:22.073546 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-f10b244b-4dc8-4f64-98ff-a08d8dbec9d4 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/95006bd1-bda3-4e1e-8c2a-814e631d2110" status: 404 len: 109 microversion: 2.1 time: 0.126320 Jun 07 08:38:22.073546 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 20/36] 10.222.0.17 () {58 vars in 1247 bytes} [Tue Jun 7 08:38:21 2022] DELETE /compute/v2.1/os-volumes/95006bd1-bda3-4e1e-8c2a-814e631d2110 => generated 109 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:38:22.089248 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-1f8de3cc-c3e3-460a-a991-1adc34bd4bd3 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] Calling method '.version_select at 0x7f7feea10a60>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:22.169059 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.wsgi [None req-1f8de3cc-c3e3-460a-a991-1adc34bd4bd3 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] HTTP exception thrown: Volume 95006bd1-bda3-4e1e-8c2a-814e631d2110 could not be found. Jun 07 08:38:22.177070 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-1f8de3cc-c3e3-460a-a991-1adc34bd4bd3 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] Request method failure captured: Jun 07 08:38:22.177070 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: request: GET /compute/v2.1/os-volumes/95006bd1-bda3-4e1e-8c2a-814e631d2110 HTTP/1.1 Jun 07 08:38:22.177070 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept: application/json Jun 07 08:38:22.177070 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept-Encoding: identity Jun 07 08:38:22.177070 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Connection: close Jun 07 08:38:22.177070 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Length: 0 Jun 07 08:38:22.177070 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Type: application/json Jun 07 08:38:22.177070 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Host: 10.222.0.17 Jun 07 08:38:22.177070 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Openstack-System-Scope: None Jun 07 08:38:22.177070 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: User-Agent: python-urllib3/1.26.9 Jun 07 08:38:22.177070 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Auth-Token: gAAAAABinw5urbMKoh0O4j3qrbPRQU2kdwkUjuZ-O2Avc4IEXXyfWfJpjOybybjtO1Gvgv8YlScCJP913Sazgpy19nCgD1h8zdXGlhQfxwsnjZk2CL4EvqU0SMbtnVcyRrLB4rogPjK6ltjQ0BY28mcjeMN-WtlNcNPwpip9_LNqkL-UwoCVmAQ Jun 07 08:38:22.177070 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Id: None Jun 07 08:38:22.177070 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Name: None Jun 07 08:38:22.177070 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Identity-Status: Confirmed Jun 07 08:38:22.177070 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Is-Admin-Project: True Jun 07 08:38:22.177070 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Id: default Jun 07 08:38:22.177070 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Name: Default Jun 07 08:38:22.177070 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Id: f0e5af0d10f448bdad3536aded64709a Jun 07 08:38:22.177070 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-537365179 Jun 07 08:38:22.177070 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Role: reader,member Jun 07 08:38:22.177070 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Roles: reader,member Jun 07 08:38:22.179427 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f0e5af0d10f448bdad3536aded64709a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f0e5af0d10f448bdad3536aded64709a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f0e5af0d10f448bdad3536aded64709a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f0e5af0d10f448bdad3536aded64709a"}]}] Jun 07 08:38:22.179427 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant: tempest-VolumesSnapshotsTestJSON-537365179 Jun 07 08:38:22.179427 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Id: f0e5af0d10f448bdad3536aded64709a Jun 07 08:38:22.179427 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-537365179 Jun 07 08:38:22.179427 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User: tempest-VolumesSnapshotsTestJSON-537365179-project Jun 07 08:38:22.179427 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Id: default Jun 07 08:38:22.179427 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Name: Default Jun 07 08:38:22.179427 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Id: 89b9c8a15aee4129a24abd82eaa54c05 Jun 07 08:38:22.179427 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Name: tempest-VolumesSnapshotsTestJSON-537365179-project Jun 07 08:38:22.179427 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: method: Jun 07 08:38:22.179427 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: exception: Volume 95006bd1-bda3-4e1e-8c2a-814e631d2110 could not be found. Jun 07 08:38:22.179427 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: action_args: {'id': '95006bd1-bda3-4e1e-8c2a-814e631d2110'} Jun 07 08:38:22.179427 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:38:22.180286 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:22.180286 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 08:38:22.180286 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 08:38:22.180286 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 08:38:22.180286 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 08:38:22.180286 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 08:38:22.180286 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 08:38:22.180286 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 08:38:22.180286 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 08:38:22.180286 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 08:38:22.180286 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 08:38:22.180286 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 08:38:22.180286 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 08:38:22.180286 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 08:38:22.180286 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 08:38:22.180286 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 95006bd1-bda3-4e1e-8c2a-814e631d2110 could not be found. (HTTP 404) (Request-ID: req-22a6a3d4-178d-445a-b7a8-d8e3d8ce4f14) Jun 07 08:38:22.180286 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:22.180286 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:38:22.180286 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:22.182320 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:22.182320 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 08:38:22.182320 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 08:38:22.182320 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 08:38:22.182320 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 08:38:22.182320 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 08:38:22.182320 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 08:38:22.182320 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 08:38:22.182320 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 08:38:22.182320 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 08:38:22.182320 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 08:38:22.182320 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 08:38:22.182320 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 08:38:22.182320 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 08:38:22.182320 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 08:38:22.182320 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 08:38:22.182320 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 08:38:22.182320 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 08:38:22.182320 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 08:38:22.187586 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 08:38:22.187586 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 08:38:22.187586 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 08:38:22.187586 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 08:38:22.187586 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 95006bd1-bda3-4e1e-8c2a-814e631d2110 could not be found. Jun 07 08:38:22.187586 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:22.187586 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:38:22.187586 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:22.187586 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:22.187586 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:38:22.187586 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:38:22.187586 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:38:22.187586 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:38:22.187586 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 08:38:22.187586 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 08:38:22.187586 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:38:22.187586 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:38:22.187586 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 08:38:22.187586 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:38:22.188768 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 95006bd1-bda3-4e1e-8c2a-814e631d2110 could not be found. Jun 07 08:38:22.188768 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:22.188768 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:38:22.188768 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:22.188768 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:22.188768 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:38:22.188768 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:38:22.188768 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:38:22.188768 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:38:22.188768 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 95006bd1-bda3-4e1e-8c2a-814e631d2110 could not be found. Jun 07 08:38:22.188768 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:22.194180 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-1f8de3cc-c3e3-460a-a991-1adc34bd4bd3 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] Returning 404 to user: Volume 95006bd1-bda3-4e1e-8c2a-814e631d2110 could not be found. {{(pid=129725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:38:22.196673 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-1f8de3cc-c3e3-460a-a991-1adc34bd4bd3 tempest-VolumesSnapshotsTestJSON-537365179 tempest-VolumesSnapshotsTestJSON-537365179-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/95006bd1-bda3-4e1e-8c2a-814e631d2110" status: 404 len: 109 microversion: 2.1 time: 0.124185 Jun 07 08:38:22.198451 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 21/37] 10.222.0.17 () {58 vars in 1244 bytes} [Tue Jun 7 08:38:22 2022] GET /compute/v2.1/os-volumes/95006bd1-bda3-4e1e-8c2a-814e631d2110 => generated 109 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:38:22.565046 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-c08bafb1-0d36-46f5-a024-82e6a2480c49 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:22.565917 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-c08bafb1-0d36-46f5-a024-82e6a2480c49 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:22.595056 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c08bafb1-0d36-46f5-a024-82e6a2480c49 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:22.595529 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c08bafb1-0d36-46f5-a024-82e6a2480c49 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:22.596478 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c08bafb1-0d36-46f5-a024-82e6a2480c49 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:22.600313 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c08bafb1-0d36-46f5-a024-82e6a2480c49 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:23.068816 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-425a1db4-cb26-42df-ab07-dc97324f7727 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Flavor limits 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 08:38:23.074423 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-425a1db4-cb26-42df-ab07-dc97324f7727 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Image limits 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 08:38:23.075093 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-425a1db4-cb26-42df-ab07-dc97324f7727 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Flavor pref 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 08:38:23.075632 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-425a1db4-cb26-42df-ab07-dc97324f7727 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Image pref 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 08:38:23.076152 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-425a1db4-cb26-42df-ab07-dc97324f7727 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 08:38:23.170199 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-425a1db4-cb26-42df-ab07-dc97324f7727 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:23.173684 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-425a1db4-cb26-42df-ab07-dc97324f7727 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.040s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:23.175653 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-425a1db4-cb26-42df-ab07-dc97324f7727 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:23.182871 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-425a1db4-cb26-42df-ab07-dc97324f7727 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:23.354577 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-425a1db4-cb26-42df-ab07-dc97324f7727 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Getting quotas for project 10b79d91933b4f7f9f32d66138e18373. Resources: {'ram', 'cores', 'instances'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 08:38:23.368352 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-425a1db4-cb26-42df-ab07-dc97324f7727 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Getting quotas for user 055ec8a54bdf400fac0a46b0e5497f1b and project 10b79d91933b4f7f9f32d66138e18373. Resources: {'ram', 'cores', 'instances'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 08:38:23.390674 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-425a1db4-cb26-42df-ab07-dc97324f7727 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Going to run 1 instances... {{(pid=129726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 08:38:23.401569 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-425a1db4-cb26-42df-ab07-dc97324f7727 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c04b0a92-7675-47c3-bcc2-8a2a59b997c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 08:38:23.609630 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-c08bafb1-0d36-46f5-a024-82e6a2480c49 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae58168dadc845daa0958cf975a41abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ee9298ae04230979b6a62d24be0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:23.626393 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-c08bafb1-0d36-46f5-a024-82e6a2480c49 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77" status: 200 len: 1315 microversion: 2.1 time: 1.066513 Jun 07 08:38:23.633095 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 22/38] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:22 2022] GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 => generated 1315 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:23.812710 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-425a1db4-cb26-42df-ab07-dc97324f7727 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.119595 Jun 07 08:38:23.817135 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 17/39] 10.222.0.17 () {60 vars in 1146 bytes} [Tue Jun 7 08:38:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 5126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 08:38:23.834671 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-68221ccc-47c3-4d17-bac5-46ce27d403fa tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:23.836630 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-68221ccc-47c3-4d17-bac5-46ce27d403fa tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:24.070468 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell0:SELECT=2 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:38:24.112709 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-68221ccc-47c3-4d17-bac5-46ce27d403fa tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:24.121557 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-68221ccc-47c3-4d17-bac5-46ce27d403fa tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1221 microversion: 2.1 time: 0.296879 Jun 07 08:38:24.122662 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 23/40] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:23 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1221 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:24.661140 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-5694b47d-1428-486b-ab47-0f795f3dd935 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:24.662148 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-5694b47d-1428-486b-ab47-0f795f3dd935 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:24.685862 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5694b47d-1428-486b-ab47-0f795f3dd935 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:24.687660 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5694b47d-1428-486b-ab47-0f795f3dd935 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:24.690426 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5694b47d-1428-486b-ab47-0f795f3dd935 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:24.693598 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5694b47d-1428-486b-ab47-0f795f3dd935 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:25.389716 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-084fdbb5-ea8c-41e5-b624-f571bdcdd606 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Action: 'create', calling method: .version_select at 0x7f7fee8c8670>, body: {"keypair": {"name": "tempest-keypair-1412436988", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWEI7QOxqeH8yJNP3gsr1uSEfp5l2PMq7nA5+WrZLELSeqCrD0WCJRRJwEzwxDABiILeSdXojYHRAlnOy4/hkNS+LFCio9W4e5Ol2Zw/YeM9zvCXVf+mRqMl01rl0P30w=="}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:38:25.513969 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-084fdbb5-ea8c-41e5-b624-f571bdcdd606 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Getting quotas for project 4f25f022755d465fac40f2681eaef0a5. Resources: {'key_pairs'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 08:38:25.534871 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-084fdbb5-ea8c-41e5-b624-f571bdcdd606 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Getting quotas for user 0b2efb9857cf495f8b51a96b5f868d44 and project 4f25f022755d465fac40f2681eaef0a5. Resources: {'key_pairs'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 08:38:25.699462 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-5694b47d-1428-486b-ab47-0f795f3dd935 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae58168dadc845daa0958cf975a41abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ee9298ae04230979b6a62d24be0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:25.712648 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-084fdbb5-ea8c-41e5-b624-f571bdcdd606 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.403152 Jun 07 08:38:25.713466 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 18/41] 10.222.0.17 () {62 vars in 1199 bytes} [Tue Jun 7 08:38:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1405 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 07 08:38:25.733846 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-b3567062-5887-4eb4-83a8-201f11e4c1a6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1369548464", "imageRef": "c04b0a92-7675-47c3-bcc2-8a2a59b997c3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:38:25.737029 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-5694b47d-1428-486b-ab47-0f795f3dd935 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77" status: 200 len: 1315 microversion: 2.1 time: 1.092721 Jun 07 08:38:25.744009 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 24/42] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:24 2022] GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 => generated 1315 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:25.904967 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.network.neutron [None req-b3567062-5887-4eb4-83a8-201f11e4c1a6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] validate_networks() for [('5db4407e-2ca4-47e4-aa62-77735c5013d3', None, None, None, None, None)] {{(pid=129726) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 08:38:26.771157 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-1117c746-42d5-415d-b9f9-4a5e2aafc04a tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:26.772318 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-1117c746-42d5-415d-b9f9-4a5e2aafc04a tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:26.807394 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1117c746-42d5-415d-b9f9-4a5e2aafc04a tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:26.810367 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1117c746-42d5-415d-b9f9-4a5e2aafc04a tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:26.826646 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1117c746-42d5-415d-b9f9-4a5e2aafc04a tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:26.830933 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1117c746-42d5-415d-b9f9-4a5e2aafc04a tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:27.155882 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-1117c746-42d5-415d-b9f9-4a5e2aafc04a tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae58168dadc845daa0958cf975a41abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ee9298ae04230979b6a62d24be0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:27.168078 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-1117c746-42d5-415d-b9f9-4a5e2aafc04a tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77" status: 200 len: 1315 microversion: 2.1 time: 0.403103 Jun 07 08:38:27.179807 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 25/43] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:26 2022] GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 => generated 1315 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:27.304059 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-b3567062-5887-4eb4-83a8-201f11e4c1a6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Flavor limits 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 08:38:27.304559 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-b3567062-5887-4eb4-83a8-201f11e4c1a6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Image limits 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 08:38:27.305379 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-b3567062-5887-4eb4-83a8-201f11e4c1a6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Flavor pref 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 08:38:27.305893 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-b3567062-5887-4eb4-83a8-201f11e4c1a6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Image pref 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 08:38:27.306405 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-b3567062-5887-4eb4-83a8-201f11e4c1a6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 08:38:27.324160 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b3567062-5887-4eb4-83a8-201f11e4c1a6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:27.334270 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b3567062-5887-4eb4-83a8-201f11e4c1a6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:27.349641 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b3567062-5887-4eb4-83a8-201f11e4c1a6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:27.353439 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b3567062-5887-4eb4-83a8-201f11e4c1a6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:27.476918 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-b3567062-5887-4eb4-83a8-201f11e4c1a6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Getting quotas for project 10b79d91933b4f7f9f32d66138e18373. Resources: {'ram', 'cores', 'instances'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 08:38:27.493989 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-b3567062-5887-4eb4-83a8-201f11e4c1a6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Getting quotas for user 055ec8a54bdf400fac0a46b0e5497f1b and project 10b79d91933b4f7f9f32d66138e18373. Resources: {'ram', 'cores', 'instances'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 08:38:27.538919 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-b3567062-5887-4eb4-83a8-201f11e4c1a6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Going to run 1 instances... {{(pid=129726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 08:38:27.556388 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-b3567062-5887-4eb4-83a8-201f11e4c1a6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c04b0a92-7675-47c3-bcc2-8a2a59b997c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 08:38:27.758967 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-b3567062-5887-4eb4-83a8-201f11e4c1a6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.036200 Jun 07 08:38:27.765903 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 19/44] 10.222.0.17 () {60 vars in 1146 bytes} [Tue Jun 7 08:38:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 2051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 08:38:27.770201 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-66fdfb69-66a4-451d-9507-92cdb80080fc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:27.771153 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-66fdfb69-66a4-451d-9507-92cdb80080fc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:27.888300 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-66fdfb69-66a4-451d-9507-92cdb80080fc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:27.900381 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-66fdfb69-66a4-451d-9507-92cdb80080fc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1222 microversion: 2.1 time: 0.133822 Jun 07 08:38:27.905076 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 26/45] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:27 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1222 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:28.188643 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-ae03e35e-5822-430c-9e39-3c1e54f6fe94 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:28.189355 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-ae03e35e-5822-430c-9e39-3c1e54f6fe94 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:28.222699 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ae03e35e-5822-430c-9e39-3c1e54f6fe94 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:28.227741 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ae03e35e-5822-430c-9e39-3c1e54f6fe94 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:28.230214 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ae03e35e-5822-430c-9e39-3c1e54f6fe94 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:28.233996 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ae03e35e-5822-430c-9e39-3c1e54f6fe94 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:28.921466 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-922dec70-ad03-4c13-92ea-02fb424012f6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:28.922144 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-922dec70-ad03-4c13-92ea-02fb424012f6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:29.332848 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-922dec70-ad03-4c13-92ea-02fb424012f6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:29.346183 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-922dec70-ad03-4c13-92ea-02fb424012f6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1222 microversion: 2.1 time: 0.429409 Jun 07 08:38:29.347025 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 27/46] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:28 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1222 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:38:29.635759 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-ae03e35e-5822-430c-9e39-3c1e54f6fe94 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae58168dadc845daa0958cf975a41abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ee9298ae04230979b6a62d24be0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:29.653130 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-ae03e35e-5822-430c-9e39-3c1e54f6fe94 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77" status: 200 len: 1315 microversion: 2.1 time: 1.469497 Jun 07 08:38:29.657761 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 20/47] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:28 2022] GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 => generated 1315 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:38:29.956190 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-895b8e4b-c3c7-47cc-9bff-46c2c9a6b12a tempest-VolumesGetTestJSON-601127146 tempest-VolumesGetTestJSON-601127146-project] Action: 'create', calling method: .version_select at 0x7f7fee05b310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-312183084", "metadata": {"Type": "work"}}} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:38:30.365348 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-773c5a0d-e8ad-450d-b4f7-6bec994ff16b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:30.366016 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-773c5a0d-e8ad-450d-b4f7-6bec994ff16b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:30.381359 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-773c5a0d-e8ad-450d-b4f7-6bec994ff16b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:30.389384 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-773c5a0d-e8ad-450d-b4f7-6bec994ff16b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:30.396551 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-773c5a0d-e8ad-450d-b4f7-6bec994ff16b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:30.398577 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-773c5a0d-e8ad-450d-b4f7-6bec994ff16b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:30.612009 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-773c5a0d-e8ad-450d-b4f7-6bec994ff16b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:30.624958 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-773c5a0d-e8ad-450d-b4f7-6bec994ff16b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1218 microversion: 2.1 time: 0.261982 Jun 07 08:38:30.626592 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 21/48] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:30 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1218 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:31.026670 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-02ff442d-d39b-4503-bd53-3f90d44328d1 req-c741e338-46ff-453c-905f-317c21e60930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e0e129e-3c0a-4372-a1e8-c508a3d27e77", "tag": "9603dafb-8d69-420d-920a-0f9c65f83393"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:38:31.040294 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-02ff442d-d39b-4503-bd53-3f90d44328d1 req-c741e338-46ff-453c-905f-317c21e60930 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:31.040890 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-02ff442d-d39b-4503-bd53-3f90d44328d1 req-c741e338-46ff-453c-905f-317c21e60930 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:31.097057 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-02ff442d-d39b-4503-bd53-3f90d44328d1 req-c741e338-46ff-453c-905f-317c21e60930 service nova] Creating event network-changed:9603dafb-8d69-420d-920a-0f9c65f83393 for instance 6e0e129e-3c0a-4372-a1e8-c508a3d27e77 on hv-cinder-74014 Jun 07 08:38:31.099990 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-02ff442d-d39b-4503-bd53-3f90d44328d1 req-c741e338-46ff-453c-905f-317c21e60930 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129726) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 07 08:38:31.102372 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5bf6e731-b3c2-499b-8e65-49c9f4fb5ed3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:31.111014 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5bf6e731-b3c2-499b-8e65-49c9f4fb5ed3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:31.114291 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5bf6e731-b3c2-499b-8e65-49c9f4fb5ed3 None None] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:31.114788 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5bf6e731-b3c2-499b-8e65-49c9f4fb5ed3 None None] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:31.161325 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.compute.rpcapi [None req-5bf6e731-b3c2-499b-8e65-49c9f4fb5ed3 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 07 08:38:31.162480 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5bf6e731-b3c2-499b-8e65-49c9f4fb5ed3 None None] Releasing lock "compute-rpcapi-router" {{(pid=129726) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 07 08:38:31.199262 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-5bf6e731-b3c2-499b-8e65-49c9f4fb5ed3 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.559778 Jun 07 08:38:31.200468 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 22/49] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:38:31.222138 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-c1b34808-af75-4237-9ff8-57e036f75092 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:31.225244 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-c1b34808-af75-4237-9ff8-57e036f75092 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:31.240479 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c1b34808-af75-4237-9ff8-57e036f75092 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:31.242791 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c1b34808-af75-4237-9ff8-57e036f75092 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:31.249198 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c1b34808-af75-4237-9ff8-57e036f75092 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:31.249198 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c1b34808-af75-4237-9ff8-57e036f75092 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:31.821436 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-895b8e4b-c3c7-47cc-9bff-46c2c9a6b12a tempest-VolumesGetTestJSON-601127146 tempest-VolumesGetTestJSON-601127146-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.287462 Jun 07 08:38:31.822509 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 28/50] 10.222.0.17 () {60 vars in 1155 bytes} [Tue Jun 7 08:38:29 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2289 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 07 08:38:31.827522 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-3bcae8c1-845a-4b2a-a1b6-4f569e233204 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:31.828331 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-3bcae8c1-845a-4b2a-a1b6-4f569e233204 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:31.879872 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3bcae8c1-845a-4b2a-a1b6-4f569e233204 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:31.887215 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3bcae8c1-845a-4b2a-a1b6-4f569e233204 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:31.890112 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3bcae8c1-845a-4b2a-a1b6-4f569e233204 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:31.892570 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3bcae8c1-845a-4b2a-a1b6-4f569e233204 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:32.459704 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-3bcae8c1-845a-4b2a-a1b6-4f569e233204 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:32.515198 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-3bcae8c1-845a-4b2a-a1b6-4f569e233204 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1292 microversion: 2.1 time: 0.690861 Jun 07 08:38:32.533827 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 29/51] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:31 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1292 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:32.554615 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-bbc1559a-3a7b-4255-8de0-bf9da5e69271 tempest-VolumesGetTestJSON-601127146 tempest-VolumesGetTestJSON-601127146-project] Calling method '.version_select at 0x7f7fee05b160>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:32.892836 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-bbc1559a-3a7b-4255-8de0-bf9da5e69271 tempest-VolumesGetTestJSON-601127146 tempest-VolumesGetTestJSON-601127146-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/2a5277ec-c5b9-470f-b405-c3187c35b1d9" status: 200 len: 353 microversion: 2.1 time: 0.357177 Jun 07 08:38:32.899952 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 30/52] 10.222.0.17 () {58 vars in 1244 bytes} [Tue Jun 7 08:38:32 2022] GET /compute/v2.1/os-volumes/2a5277ec-c5b9-470f-b405-c3187c35b1d9 => generated 353 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:38:32.916785 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-e7a93d7b-50f2-4557-84d8-9659da595970 tempest-VolumesGetTestJSON-601127146 tempest-VolumesGetTestJSON-601127146-project] Calling method '.version_select at 0x7f7fee1348b0>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:33.039240 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-c1b34808-af75-4237-9ff8-57e036f75092 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae58168dadc845daa0958cf975a41abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ee9298ae04230979b6a62d24be0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:33.057730 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-c1b34808-af75-4237-9ff8-57e036f75092 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77" status: 200 len: 1315 microversion: 2.1 time: 1.849600 Jun 07 08:38:33.069709 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 23/53] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:31 2022] GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 => generated 1315 bytes in 1868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:33.546299 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-758308d8-583e-4fc0-bfe0-bc1e1881b1e8 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:33.547294 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-758308d8-583e-4fc0-bfe0-bc1e1881b1e8 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:33.555941 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-758308d8-583e-4fc0-bfe0-bc1e1881b1e8 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:33.558510 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-758308d8-583e-4fc0-bfe0-bc1e1881b1e8 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:33.559512 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-758308d8-583e-4fc0-bfe0-bc1e1881b1e8 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:33.566503 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-758308d8-583e-4fc0-bfe0-bc1e1881b1e8 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:33.587480 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-e7a93d7b-50f2-4557-84d8-9659da595970 tempest-VolumesGetTestJSON-601127146 tempest-VolumesGetTestJSON-601127146-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/2a5277ec-c5b9-470f-b405-c3187c35b1d9" status: 200 len: 353 microversion: 2.1 time: 0.686190 Jun 07 08:38:33.588518 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 31/54] 10.222.0.17 () {58 vars in 1244 bytes} [Tue Jun 7 08:38:32 2022] GET /compute/v2.1/os-volumes/2a5277ec-c5b9-470f-b405-c3187c35b1d9 => generated 353 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:38:33.601468 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-38b3e296-ba01-401e-99cc-03d50c56d5d3 tempest-VolumesGetTestJSON-601127146 tempest-VolumesGetTestJSON-601127146-project] Calling method '.version_select at 0x7f7fee134820>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:33.771441 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-758308d8-583e-4fc0-bfe0-bc1e1881b1e8 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:33.790779 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-758308d8-583e-4fc0-bfe0-bc1e1881b1e8 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1280 microversion: 2.1 time: 0.248313 Jun 07 08:38:33.802963 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 24/55] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:33 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1280 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:33.929458 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-38b3e296-ba01-401e-99cc-03d50c56d5d3 tempest-VolumesGetTestJSON-601127146 tempest-VolumesGetTestJSON-601127146-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/2a5277ec-c5b9-470f-b405-c3187c35b1d9" status: 202 len: 0 microversion: 2.1 time: 0.332497 Jun 07 08:38:33.931111 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 32/56] 10.222.0.17 () {58 vars in 1247 bytes} [Tue Jun 7 08:38:33 2022] DELETE /compute/v2.1/os-volumes/2a5277ec-c5b9-470f-b405-c3187c35b1d9 => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 08:38:33.939147 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-da10cbfd-eb77-4494-8833-2b86c50598e4 tempest-VolumesGetTestJSON-601127146 tempest-VolumesGetTestJSON-601127146-project] Calling method '.version_select at 0x7f7fed853b80>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:34.066709 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-da10cbfd-eb77-4494-8833-2b86c50598e4 tempest-VolumesGetTestJSON-601127146 tempest-VolumesGetTestJSON-601127146-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/2a5277ec-c5b9-470f-b405-c3187c35b1d9" status: 200 len: 352 microversion: 2.1 time: 0.131393 Jun 07 08:38:34.068350 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 25/57] 10.222.0.17 () {58 vars in 1244 bytes} [Tue Jun 7 08:38:33 2022] GET /compute/v2.1/os-volumes/2a5277ec-c5b9-470f-b405-c3187c35b1d9 => generated 352 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:38:34.076208 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-693d6472-d225-4a18-8879-de9382380e18 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:34.077283 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-693d6472-d225-4a18-8879-de9382380e18 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:34.100905 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-693d6472-d225-4a18-8879-de9382380e18 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:34.109500 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-693d6472-d225-4a18-8879-de9382380e18 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:34.112390 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-693d6472-d225-4a18-8879-de9382380e18 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:34.117408 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-693d6472-d225-4a18-8879-de9382380e18 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:34.728193 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-693d6472-d225-4a18-8879-de9382380e18 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae58168dadc845daa0958cf975a41abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ee9298ae04230979b6a62d24be0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:34.741849 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-693d6472-d225-4a18-8879-de9382380e18 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77" status: 200 len: 1315 microversion: 2.1 time: 0.669158 Jun 07 08:38:34.755775 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 33/58] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:34 2022] GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 => generated 1315 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:34.770618 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-582e9ddf-a88d-4ee4-8f2a-b8159894512e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1146149456", "imageRef": "c04b0a92-7675-47c3-bcc2-8a2a59b997c3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "75f0c9b9-dc0c-407e-bed7-e83c2052dc04"}], "security_groups": [{"name": "tempest-securitygroup--1886062000"}], "key_name": "tempest-keypair-1412436988", "user_data": "}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:38:34.820816 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-5bb32a85-179a-43eb-ba0d-93d57f6933c1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:34.823923 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-5bb32a85-179a-43eb-ba0d-93d57f6933c1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:34.831391 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5bb32a85-179a-43eb-ba0d-93d57f6933c1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:34.832114 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5bb32a85-179a-43eb-ba0d-93d57f6933c1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:34.832908 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5bb32a85-179a-43eb-ba0d-93d57f6933c1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:34.833384 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5bb32a85-179a-43eb-ba0d-93d57f6933c1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:34.970975 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.network.neutron [None req-582e9ddf-a88d-4ee4-8f2a-b8159894512e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] validate_networks() for [('75f0c9b9-dc0c-407e-bed7-e83c2052dc04', None, None, None, None, None)] {{(pid=129726) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 08:38:35.436316 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-5bb32a85-179a-43eb-ba0d-93d57f6933c1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:35.453216 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-5bb32a85-179a-43eb-ba0d-93d57f6933c1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1322 microversion: 2.1 time: 0.635685 Jun 07 08:38:35.454169 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 34/59] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:34 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1322 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:38:35.461651 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-02e084c5-9e16-4c63-9173-997e007b3bcc tempest-VolumesGetTestJSON-601127146 tempest-VolumesGetTestJSON-601127146-project] Calling method '.version_select at 0x7f7fee0b8ca0>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:35.593043 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-02e084c5-9e16-4c63-9173-997e007b3bcc tempest-VolumesGetTestJSON-601127146 tempest-VolumesGetTestJSON-601127146-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/2a5277ec-c5b9-470f-b405-c3187c35b1d9" status: 200 len: 352 microversion: 2.1 time: 0.136551 Jun 07 08:38:35.599563 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 35/60] 10.222.0.17 () {58 vars in 1244 bytes} [Tue Jun 7 08:38:35 2022] GET /compute/v2.1/os-volumes/2a5277ec-c5b9-470f-b405-c3187c35b1d9 => generated 352 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:38:35.686510 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-a49740fb-1556-4121-b7fb-79a94463dee1 req-aec1e40e-8be0-48d9-ac5b-1e921d72d1b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d40b0293-76f4-4ef2-9bfa-dda971ade7ea", "tag": "eb0afe08-4df3-4618-8c1a-99dacff66959"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:38:35.700964 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-a49740fb-1556-4121-b7fb-79a94463dee1 req-aec1e40e-8be0-48d9-ac5b-1e921d72d1b5 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:35.701780 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-a49740fb-1556-4121-b7fb-79a94463dee1 req-aec1e40e-8be0-48d9-ac5b-1e921d72d1b5 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:35.722319 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-a49740fb-1556-4121-b7fb-79a94463dee1 req-aec1e40e-8be0-48d9-ac5b-1e921d72d1b5 service nova] Creating event network-changed:eb0afe08-4df3-4618-8c1a-99dacff66959 for instance d40b0293-76f4-4ef2-9bfa-dda971ade7ea on hv-cinder-74014 Jun 07 08:38:35.724548 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-a49740fb-1556-4121-b7fb-79a94463dee1 req-aec1e40e-8be0-48d9-ac5b-1e921d72d1b5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129725) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 07 08:38:35.724548 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-26c73fc2-e4fc-49cd-9d62-6969ad9ae924 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:35.724548 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-26c73fc2-e4fc-49cd-9d62-6969ad9ae924 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:35.725193 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-26c73fc2-e4fc-49cd-9d62-6969ad9ae924 None None] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:35.725662 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-26c73fc2-e4fc-49cd-9d62-6969ad9ae924 None None] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:35.734604 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.compute.rpcapi [None req-26c73fc2-e4fc-49cd-9d62-6969ad9ae924 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 07 08:38:35.735746 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-26c73fc2-e4fc-49cd-9d62-6969ad9ae924 None None] Releasing lock "compute-rpcapi-router" {{(pid=129725) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 07 08:38:35.752488 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-26c73fc2-e4fc-49cd-9d62-6969ad9ae924 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149560 Jun 07 08:38:35.753723 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 36/61] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:38:35.765504 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-473df408-9f72-4823-8e7b-371f75691306 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:35.766145 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-473df408-9f72-4823-8e7b-371f75691306 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:35.778922 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-473df408-9f72-4823-8e7b-371f75691306 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:35.779802 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-473df408-9f72-4823-8e7b-371f75691306 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:35.780780 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-473df408-9f72-4823-8e7b-371f75691306 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:35.781408 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-473df408-9f72-4823-8e7b-371f75691306 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:35.947057 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-582e9ddf-a88d-4ee4-8f2a-b8159894512e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Flavor limits 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 08:38:35.947498 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-582e9ddf-a88d-4ee4-8f2a-b8159894512e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Image limits 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 08:38:35.947961 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-582e9ddf-a88d-4ee4-8f2a-b8159894512e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Flavor pref 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 08:38:35.948404 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-582e9ddf-a88d-4ee4-8f2a-b8159894512e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Image pref 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 08:38:35.948829 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-582e9ddf-a88d-4ee4-8f2a-b8159894512e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 08:38:35.957819 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-582e9ddf-a88d-4ee4-8f2a-b8159894512e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:35.958275 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-582e9ddf-a88d-4ee4-8f2a-b8159894512e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:35.959204 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-582e9ddf-a88d-4ee4-8f2a-b8159894512e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:35.959953 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-582e9ddf-a88d-4ee4-8f2a-b8159894512e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:35.977753 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-582e9ddf-a88d-4ee4-8f2a-b8159894512e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Getting quotas for project 4f25f022755d465fac40f2681eaef0a5. Resources: {'ram', 'cores', 'instances'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 08:38:35.981904 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-582e9ddf-a88d-4ee4-8f2a-b8159894512e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Getting quotas for user 0b2efb9857cf495f8b51a96b5f868d44 and project 4f25f022755d465fac40f2681eaef0a5. Resources: {'ram', 'cores', 'instances'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 08:38:35.986371 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-473df408-9f72-4823-8e7b-371f75691306 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae58168dadc845daa0958cf975a41abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ee9298ae04230979b6a62d24be0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:35.994889 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-473df408-9f72-4823-8e7b-371f75691306 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77" status: 200 len: 1315 microversion: 2.1 time: 0.234644 Jun 07 08:38:35.995422 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 37/62] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:35 2022] GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:35.996238 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-582e9ddf-a88d-4ee4-8f2a-b8159894512e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Going to run 1 instances... {{(pid=129726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 08:38:35.998702 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-582e9ddf-a88d-4ee4-8f2a-b8159894512e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c04b0a92-7675-47c3-bcc2-8a2a59b997c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 08:38:36.173341 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-582e9ddf-a88d-4ee4-8f2a-b8159894512e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.407630 Jun 07 08:38:36.174443 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 26/63] 10.222.0.17 () {62 vars in 1187 bytes} [Tue Jun 7 08:38:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 1409 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 07 08:38:36.185190 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-30c4cf95-99b5-4818-a5b1-423787560bc3 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:36.187499 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-30c4cf95-99b5-4818-a5b1-423787560bc3 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:36.255056 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-30c4cf95-99b5-4818-a5b1-423787560bc3 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:36.263351 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-30c4cf95-99b5-4818-a5b1-423787560bc3 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:36.265107 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-30c4cf95-99b5-4818-a5b1-423787560bc3 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:36.266541 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-30c4cf95-99b5-4818-a5b1-423787560bc3 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1282 microversion: 2.20 time: 0.085371 Jun 07 08:38:36.267104 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 38/64] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:38:36 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1282 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:38:36.471348 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-b70117a2-fa8c-4366-a13b-9861d4c1483d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:36.471960 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-b70117a2-fa8c-4366-a13b-9861d4c1483d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:36.478991 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b70117a2-fa8c-4366-a13b-9861d4c1483d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:36.479456 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b70117a2-fa8c-4366-a13b-9861d4c1483d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:36.485190 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b70117a2-fa8c-4366-a13b-9861d4c1483d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:36.485190 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b70117a2-fa8c-4366-a13b-9861d4c1483d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:36.605298 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-3893116a-3a80-47dd-8c50-1e7b01a7ca38 tempest-VolumesGetTestJSON-601127146 tempest-VolumesGetTestJSON-601127146-project] Calling method '.version_select at 0x7f7fee134670>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:36.631927 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-b70117a2-fa8c-4366-a13b-9861d4c1483d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:36.640102 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-b70117a2-fa8c-4366-a13b-9861d4c1483d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1322 microversion: 2.1 time: 0.172614 Jun 07 08:38:36.640678 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 27/65] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:36 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:36.718109 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-3893116a-3a80-47dd-8c50-1e7b01a7ca38 tempest-VolumesGetTestJSON-601127146 tempest-VolumesGetTestJSON-601127146-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/2a5277ec-c5b9-470f-b405-c3187c35b1d9" status: 200 len: 352 microversion: 2.1 time: 0.116542 Jun 07 08:38:36.719612 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 39/66] 10.222.0.17 () {58 vars in 1244 bytes} [Tue Jun 7 08:38:36 2022] GET /compute/v2.1/os-volumes/2a5277ec-c5b9-470f-b405-c3187c35b1d9 => generated 352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:38:37.012829 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-add9c176-251c-4e4f-b077-c8002115a234 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:37.014640 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-add9c176-251c-4e4f-b077-c8002115a234 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:37.018116 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=10 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:38:37.025804 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-add9c176-251c-4e4f-b077-c8002115a234 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:37.026257 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-add9c176-251c-4e4f-b077-c8002115a234 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:37.027039 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-add9c176-251c-4e4f-b077-c8002115a234 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:37.027710 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-add9c176-251c-4e4f-b077-c8002115a234 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:37.196530 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-add9c176-251c-4e4f-b077-c8002115a234 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae58168dadc845daa0958cf975a41abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ee9298ae04230979b6a62d24be0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:37.207110 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-add9c176-251c-4e4f-b077-c8002115a234 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77" status: 200 len: 1315 microversion: 2.1 time: 0.196320 Jun 07 08:38:37.209431 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 28/67] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:37 2022] GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:37.286556 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-dca25780-0df7-4317-a4a8-5d8465ab4be4 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:37.287457 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-dca25780-0df7-4317-a4a8-5d8465ab4be4 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:37.354582 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-dca25780-0df7-4317-a4a8-5d8465ab4be4 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:37.362651 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-dca25780-0df7-4317-a4a8-5d8465ab4be4 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:37.364158 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-dca25780-0df7-4317-a4a8-5d8465ab4be4 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:37.381387 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-dca25780-0df7-4317-a4a8-5d8465ab4be4 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1282 microversion: 2.20 time: 0.099941 Jun 07 08:38:37.392673 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 40/68] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:38:37 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1282 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:38:37.661430 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-5bf10efd-08e0-410b-afa1-994e4b3619e0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:37.662361 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-5bf10efd-08e0-410b-afa1-994e4b3619e0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:37.695726 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5bf10efd-08e0-410b-afa1-994e4b3619e0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:37.695726 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5bf10efd-08e0-410b-afa1-994e4b3619e0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:37.695726 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5bf10efd-08e0-410b-afa1-994e4b3619e0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:37.695726 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5bf10efd-08e0-410b-afa1-994e4b3619e0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:37.736138 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-7062c080-4406-47f5-9c01-8c12134438b7 tempest-VolumesGetTestJSON-601127146 tempest-VolumesGetTestJSON-601127146-project] Calling method '.version_select at 0x7f7fee05bc10>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:37.796555 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.wsgi [None req-7062c080-4406-47f5-9c01-8c12134438b7 tempest-VolumesGetTestJSON-601127146 tempest-VolumesGetTestJSON-601127146-project] HTTP exception thrown: Volume 2a5277ec-c5b9-470f-b405-c3187c35b1d9 could not be found. Jun 07 08:38:37.799045 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-7062c080-4406-47f5-9c01-8c12134438b7 tempest-VolumesGetTestJSON-601127146 tempest-VolumesGetTestJSON-601127146-project] Request method failure captured: Jun 07 08:38:37.799045 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: request: GET /compute/v2.1/os-volumes/2a5277ec-c5b9-470f-b405-c3187c35b1d9 HTTP/1.1 Jun 07 08:38:37.799045 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept: application/json Jun 07 08:38:37.799045 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept-Encoding: identity Jun 07 08:38:37.799045 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Connection: close Jun 07 08:38:37.799045 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Length: 0 Jun 07 08:38:37.799045 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Type: application/json Jun 07 08:38:37.799045 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Host: 10.222.0.17 Jun 07 08:38:37.799045 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Openstack-System-Scope: None Jun 07 08:38:37.799045 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: User-Agent: python-urllib3/1.26.9 Jun 07 08:38:37.799045 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Auth-Token: gAAAAABinw6FFqkZAWYsyYHbHgNQljlEh03lMHKp9Tm5YOuMgzmgqR9auC9bh2oa4gJOcjnU3ksLxlVBogSQgSYFTjX0W6YefJmvFGLH7-hQbjK9w5D-t65hrtKg7yrcT6ApKpyzPYTt7kd8gIWUzf6EZ0pGhHj6pp6JcwrGayRuGH96QFmKHf8 Jun 07 08:38:37.799045 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Id: None Jun 07 08:38:37.799045 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Name: None Jun 07 08:38:37.799045 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Identity-Status: Confirmed Jun 07 08:38:37.799045 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Is-Admin-Project: True Jun 07 08:38:37.799045 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Id: default Jun 07 08:38:37.799045 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Name: Default Jun 07 08:38:37.799045 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Id: fb4a6b81990b40ac958b028bff582296 Jun 07 08:38:37.799045 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Name: tempest-VolumesGetTestJSON-601127146 Jun 07 08:38:37.799045 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Role: reader,member Jun 07 08:38:37.799045 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Roles: reader,member Jun 07 08:38:37.800385 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fb4a6b81990b40ac958b028bff582296"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fb4a6b81990b40ac958b028bff582296"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fb4a6b81990b40ac958b028bff582296", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fb4a6b81990b40ac958b028bff582296"}]}] Jun 07 08:38:37.800385 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant: tempest-VolumesGetTestJSON-601127146 Jun 07 08:38:37.800385 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Id: fb4a6b81990b40ac958b028bff582296 Jun 07 08:38:37.800385 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Name: tempest-VolumesGetTestJSON-601127146 Jun 07 08:38:37.800385 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User: tempest-VolumesGetTestJSON-601127146-project Jun 07 08:38:37.800385 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Id: default Jun 07 08:38:37.800385 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Name: Default Jun 07 08:38:37.800385 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Id: 89473e52c78240e88665e4b1c487cd12 Jun 07 08:38:37.800385 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Name: tempest-VolumesGetTestJSON-601127146-project Jun 07 08:38:37.800385 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: method: Jun 07 08:38:37.800385 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: exception: Volume 2a5277ec-c5b9-470f-b405-c3187c35b1d9 could not be found. Jun 07 08:38:37.800385 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: action_args: {'id': '2a5277ec-c5b9-470f-b405-c3187c35b1d9'} Jun 07 08:38:37.800385 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:38:37.801112 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:37.801112 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 08:38:37.801112 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 08:38:37.801112 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 08:38:37.801112 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 08:38:37.801112 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 08:38:37.801112 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 08:38:37.801112 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 08:38:37.801112 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 08:38:37.801112 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 08:38:37.801112 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 08:38:37.801112 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 08:38:37.801112 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 08:38:37.801112 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 08:38:37.801112 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 08:38:37.801112 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2a5277ec-c5b9-470f-b405-c3187c35b1d9 could not be found. (HTTP 404) (Request-ID: req-f46f68a7-fc1c-40f0-b0eb-1ee2cc5d17a8) Jun 07 08:38:37.801112 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:37.801112 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:38:37.801112 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:37.802212 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:37.802212 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 08:38:37.802212 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 08:38:37.802212 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 08:38:37.802212 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 08:38:37.802212 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 08:38:37.802212 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 08:38:37.802212 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 08:38:37.802212 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 08:38:37.802212 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 08:38:37.802212 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 08:38:37.802212 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 08:38:37.802212 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 08:38:37.802212 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 08:38:37.802212 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 08:38:37.802212 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 08:38:37.802212 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 08:38:37.802212 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 08:38:37.802212 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 08:38:37.803132 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 08:38:37.803132 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 08:38:37.803132 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 08:38:37.803132 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 08:38:37.803132 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2a5277ec-c5b9-470f-b405-c3187c35b1d9 could not be found. Jun 07 08:38:37.803132 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:37.803132 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:38:37.803132 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:37.803132 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:37.803132 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:38:37.803132 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:38:37.803132 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:38:37.803132 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:38:37.803132 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 08:38:37.803132 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 08:38:37.803132 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:38:37.803132 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:38:37.803132 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 08:38:37.803132 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:38:37.807041 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2a5277ec-c5b9-470f-b405-c3187c35b1d9 could not be found. Jun 07 08:38:37.807041 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:37.807041 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:38:37.807041 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:37.807041 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:37.807041 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:38:37.807041 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:38:37.807041 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:38:37.807041 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:38:37.807041 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2a5277ec-c5b9-470f-b405-c3187c35b1d9 could not be found. Jun 07 08:38:37.807041 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:37.810132 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-7062c080-4406-47f5-9c01-8c12134438b7 tempest-VolumesGetTestJSON-601127146 tempest-VolumesGetTestJSON-601127146-project] Returning 404 to user: Volume 2a5277ec-c5b9-470f-b405-c3187c35b1d9 could not be found. {{(pid=129725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:38:37.811173 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-7062c080-4406-47f5-9c01-8c12134438b7 tempest-VolumesGetTestJSON-601127146 tempest-VolumesGetTestJSON-601127146-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/2a5277ec-c5b9-470f-b405-c3187c35b1d9" status: 404 len: 109 microversion: 2.1 time: 0.079395 Jun 07 08:38:37.811891 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 41/69] 10.222.0.17 () {58 vars in 1244 bytes} [Tue Jun 7 08:38:37 2022] GET /compute/v2.1/os-volumes/2a5277ec-c5b9-470f-b405-c3187c35b1d9 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:38:38.015944 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-5bf10efd-08e0-410b-afa1-994e4b3619e0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:38.029172 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-5bf10efd-08e0-410b-afa1-994e4b3619e0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1322 microversion: 2.1 time: 0.373419 Jun 07 08:38:38.030066 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 29/70] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:37 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1322 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:38.227829 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-7b6bdb84-5a39-4da6-9b19-930cae6d7757 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:38.228574 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-7b6bdb84-5a39-4da6-9b19-930cae6d7757 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:38.237803 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7b6bdb84-5a39-4da6-9b19-930cae6d7757 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:38.241870 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7b6bdb84-5a39-4da6-9b19-930cae6d7757 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:38.243608 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7b6bdb84-5a39-4da6-9b19-930cae6d7757 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:38.244561 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7b6bdb84-5a39-4da6-9b19-930cae6d7757 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:38.405195 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-7b6bdb84-5a39-4da6-9b19-930cae6d7757 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae58168dadc845daa0958cf975a41abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ee9298ae04230979b6a62d24be0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:38.405626 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-5476ff25-d496-4442-8914-564b2c79b457 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:38.405626 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-5476ff25-d496-4442-8914-564b2c79b457 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:38.420723 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-7b6bdb84-5a39-4da6-9b19-930cae6d7757 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77" status: 200 len: 1315 microversion: 2.1 time: 0.197244 Jun 07 08:38:38.421327 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 42/71] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:38 2022] GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:38.426095 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5476ff25-d496-4442-8914-564b2c79b457 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:38.426095 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5476ff25-d496-4442-8914-564b2c79b457 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:38.426095 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5476ff25-d496-4442-8914-564b2c79b457 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:38.426330 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5476ff25-d496-4442-8914-564b2c79b457 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:38.538827 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-5476ff25-d496-4442-8914-564b2c79b457 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:38.550982 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-5476ff25-d496-4442-8914-564b2c79b457 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:38.557725 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-5476ff25-d496-4442-8914-564b2c79b457 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:38.559033 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-5476ff25-d496-4442-8914-564b2c79b457 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1286 microversion: 2.20 time: 0.163156 Jun 07 08:38:38.572095 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 30/72] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:38:38 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1286 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:38:39.047923 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-19dacb9d-be3d-4ce3-8bf2-54e036d94f10 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:39.048737 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-19dacb9d-be3d-4ce3-8bf2-54e036d94f10 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:39.055351 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-19dacb9d-be3d-4ce3-8bf2-54e036d94f10 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:39.055812 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-19dacb9d-be3d-4ce3-8bf2-54e036d94f10 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:39.056587 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-19dacb9d-be3d-4ce3-8bf2-54e036d94f10 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:39.057044 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-19dacb9d-be3d-4ce3-8bf2-54e036d94f10 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:39.443151 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-f4f64be0-b614-4200-8ba9-67a665e3a9e5 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:39.443984 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-f4f64be0-b614-4200-8ba9-67a665e3a9e5 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:39.451695 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f4f64be0-b614-4200-8ba9-67a665e3a9e5 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:39.456202 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f4f64be0-b614-4200-8ba9-67a665e3a9e5 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:39.457156 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f4f64be0-b614-4200-8ba9-67a665e3a9e5 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:39.457615 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f4f64be0-b614-4200-8ba9-67a665e3a9e5 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:39.668596 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-f4f64be0-b614-4200-8ba9-67a665e3a9e5 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae58168dadc845daa0958cf975a41abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ee9298ae04230979b6a62d24be0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:39.677637 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-f4f64be0-b614-4200-8ba9-67a665e3a9e5 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77" status: 200 len: 1315 microversion: 2.1 time: 0.238338 Jun 07 08:38:39.688035 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-19dacb9d-be3d-4ce3-8bf2-54e036d94f10 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:39.688908 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 31/73] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:39 2022] GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:38:39.694338 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-9375aba2-194c-4198-ae31-2bc48fa5ef48 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:39.695069 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-9375aba2-194c-4198-ae31-2bc48fa5ef48 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:39.698957 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-19dacb9d-be3d-4ce3-8bf2-54e036d94f10 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1322 microversion: 2.1 time: 0.653769 Jun 07 08:38:39.701223 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 43/74] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:39 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1322 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:39.702074 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9375aba2-194c-4198-ae31-2bc48fa5ef48 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:39.702746 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9375aba2-194c-4198-ae31-2bc48fa5ef48 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:39.705055 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9375aba2-194c-4198-ae31-2bc48fa5ef48 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:39.705683 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9375aba2-194c-4198-ae31-2bc48fa5ef48 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:39.809992 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-9375aba2-194c-4198-ae31-2bc48fa5ef48 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:39.819696 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-9375aba2-194c-4198-ae31-2bc48fa5ef48 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:39.821257 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-9375aba2-194c-4198-ae31-2bc48fa5ef48 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:39.822562 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-9375aba2-194c-4198-ae31-2bc48fa5ef48 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1286 microversion: 2.20 time: 0.132391 Jun 07 08:38:39.823200 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 32/75] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:38:39 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1286 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:38:40.571556 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-7c44b6be-ec0c-4965-9aa9-cb661f7c296c req-4a57e682-bea4-4a80-ac1f-0cac3116325c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b020097d-7d41-4338-a7a8-fe85f295435c", "tag": "98df96b5-be22-44b0-9b8f-858fd497d562"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:38:40.583235 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-7c44b6be-ec0c-4965-9aa9-cb661f7c296c req-4a57e682-bea4-4a80-ac1f-0cac3116325c service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:40.585860 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-7c44b6be-ec0c-4965-9aa9-cb661f7c296c req-4a57e682-bea4-4a80-ac1f-0cac3116325c service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:40.628958 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-7c44b6be-ec0c-4965-9aa9-cb661f7c296c req-4a57e682-bea4-4a80-ac1f-0cac3116325c service nova] Creating event network-changed:98df96b5-be22-44b0-9b8f-858fd497d562 for instance b020097d-7d41-4338-a7a8-fe85f295435c on hv-cinder-74014 Jun 07 08:38:40.633147 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-7c44b6be-ec0c-4965-9aa9-cb661f7c296c req-4a57e682-bea4-4a80-ac1f-0cac3116325c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065134 Jun 07 08:38:40.635947 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 44/76] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:38:40.695639 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-f8431450-ac45-4968-a20a-ed9da1f794d4 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:40.696315 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-f8431450-ac45-4968-a20a-ed9da1f794d4 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:40.706480 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f8431450-ac45-4968-a20a-ed9da1f794d4 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:40.707204 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f8431450-ac45-4968-a20a-ed9da1f794d4 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:40.708156 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f8431450-ac45-4968-a20a-ed9da1f794d4 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:40.713237 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f8431450-ac45-4968-a20a-ed9da1f794d4 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:40.720649 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-e9a3ce19-4766-4aea-865e-e0cf14a1c7e5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:40.726520 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-e9a3ce19-4766-4aea-865e-e0cf14a1c7e5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:40.732394 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e9a3ce19-4766-4aea-865e-e0cf14a1c7e5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:40.732852 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e9a3ce19-4766-4aea-865e-e0cf14a1c7e5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:40.735625 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e9a3ce19-4766-4aea-865e-e0cf14a1c7e5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:40.737156 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e9a3ce19-4766-4aea-865e-e0cf14a1c7e5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:40.984903 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-e9a3ce19-4766-4aea-865e-e0cf14a1c7e5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:41.004876 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-e9a3ce19-4766-4aea-865e-e0cf14a1c7e5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1322 microversion: 2.1 time: 0.292374 Jun 07 08:38:41.010678 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 45/77] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:40 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:38:41.017544 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-f8431450-ac45-4968-a20a-ed9da1f794d4 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae58168dadc845daa0958cf975a41abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ee9298ae04230979b6a62d24be0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:41.020007 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-a2949fed-402f-4f6c-ba24-da6a63420240 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:41.029923 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-a2949fed-402f-4f6c-ba24-da6a63420240 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:41.031560 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-f8431450-ac45-4968-a20a-ed9da1f794d4 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77" status: 200 len: 1315 microversion: 2.1 time: 0.339648 Jun 07 08:38:41.032650 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 33/78] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:40 2022] GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:41.051076 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a2949fed-402f-4f6c-ba24-da6a63420240 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:41.051883 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a2949fed-402f-4f6c-ba24-da6a63420240 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:41.054059 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a2949fed-402f-4f6c-ba24-da6a63420240 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:41.054887 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a2949fed-402f-4f6c-ba24-da6a63420240 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:41.145281 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-a2949fed-402f-4f6c-ba24-da6a63420240 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:41.154653 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-a2949fed-402f-4f6c-ba24-da6a63420240 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:41.165484 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-a2949fed-402f-4f6c-ba24-da6a63420240 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:41.167800 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-a2949fed-402f-4f6c-ba24-da6a63420240 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1278 microversion: 2.20 time: 0.154946 Jun 07 08:38:41.174185 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 46/79] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:38:41 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:38:42.028257 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-a37aee6f-b785-4a49-94f7-999b7e389d16 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:42.029522 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-a37aee6f-b785-4a49-94f7-999b7e389d16 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:42.037913 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a37aee6f-b785-4a49-94f7-999b7e389d16 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:42.038367 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a37aee6f-b785-4a49-94f7-999b7e389d16 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:42.039136 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a37aee6f-b785-4a49-94f7-999b7e389d16 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:42.039570 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a37aee6f-b785-4a49-94f7-999b7e389d16 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:42.052631 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-363451f3-d59c-4817-8552-09a85242191c tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:42.053926 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-363451f3-d59c-4817-8552-09a85242191c tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:42.063738 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-363451f3-d59c-4817-8552-09a85242191c tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:42.065954 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-363451f3-d59c-4817-8552-09a85242191c tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:42.066926 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-363451f3-d59c-4817-8552-09a85242191c tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:42.070010 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-363451f3-d59c-4817-8552-09a85242191c tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:42.295486 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-a37aee6f-b785-4a49-94f7-999b7e389d16 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:42.315144 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-a37aee6f-b785-4a49-94f7-999b7e389d16 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1322 microversion: 2.1 time: 0.289720 Jun 07 08:38:42.318941 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 34/80] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:42 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:42.331545 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-35116c7c-8b7c-4d82-bd89-60573a545545 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:42.334306 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-35116c7c-8b7c-4d82-bd89-60573a545545 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:42.353603 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-35116c7c-8b7c-4d82-bd89-60573a545545 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:42.359619 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-35116c7c-8b7c-4d82-bd89-60573a545545 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:42.359619 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-35116c7c-8b7c-4d82-bd89-60573a545545 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:42.359619 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-35116c7c-8b7c-4d82-bd89-60573a545545 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:42.456933 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-35116c7c-8b7c-4d82-bd89-60573a545545 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:42.470616 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-35116c7c-8b7c-4d82-bd89-60573a545545 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:42.471202 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-35116c7c-8b7c-4d82-bd89-60573a545545 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:42.472353 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-35116c7c-8b7c-4d82-bd89-60573a545545 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1342 microversion: 2.20 time: 0.151448 Jun 07 08:38:42.472925 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 35/81] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:38:42 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1342 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:38:42.621417 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-363451f3-d59c-4817-8552-09a85242191c tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae58168dadc845daa0958cf975a41abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ee9298ae04230979b6a62d24be0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:42.623815 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=91 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:38:42.632276 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-363451f3-d59c-4817-8552-09a85242191c tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77" status: 200 len: 1315 microversion: 2.1 time: 0.585454 Jun 07 08:38:42.648647 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 47/82] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:42 2022] GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 => generated 1315 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:43.335459 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-fd294888-e6a7-437b-81f5-ec3efde991cc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:43.337561 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-fd294888-e6a7-437b-81f5-ec3efde991cc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:43.343441 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fd294888-e6a7-437b-81f5-ec3efde991cc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:43.343981 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fd294888-e6a7-437b-81f5-ec3efde991cc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:43.344871 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fd294888-e6a7-437b-81f5-ec3efde991cc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:43.345407 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fd294888-e6a7-437b-81f5-ec3efde991cc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:43.492466 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-fa58a852-ed31-42fc-a7f5-0cde82bdcc42 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:43.493557 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-fa58a852-ed31-42fc-a7f5-0cde82bdcc42 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:43.496816 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:38:43.505259 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-fa58a852-ed31-42fc-a7f5-0cde82bdcc42 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:43.508616 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-fa58a852-ed31-42fc-a7f5-0cde82bdcc42 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:43.511483 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-fa58a852-ed31-42fc-a7f5-0cde82bdcc42 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:43.512097 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-fa58a852-ed31-42fc-a7f5-0cde82bdcc42 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:43.681897 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-fd294888-e6a7-437b-81f5-ec3efde991cc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:43.685562 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=100 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:38:43.697582 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-fd294888-e6a7-437b-81f5-ec3efde991cc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1322 microversion: 2.1 time: 0.365819 Jun 07 08:38:43.708216 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 36/83] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:43 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1322 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:43.717965 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-ff2161a7-d4d1-4d7c-a226-34f05b975a73 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:43.718580 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-ff2161a7-d4d1-4d7c-a226-34f05b975a73 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:43.730181 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ff2161a7-d4d1-4d7c-a226-34f05b975a73 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:43.731275 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ff2161a7-d4d1-4d7c-a226-34f05b975a73 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:43.732565 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ff2161a7-d4d1-4d7c-a226-34f05b975a73 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:43.733579 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ff2161a7-d4d1-4d7c-a226-34f05b975a73 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:43.734944 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-fa58a852-ed31-42fc-a7f5-0cde82bdcc42 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:43.752144 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-fa58a852-ed31-42fc-a7f5-0cde82bdcc42 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:43.757551 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-fa58a852-ed31-42fc-a7f5-0cde82bdcc42 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:43.770296 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-fa58a852-ed31-42fc-a7f5-0cde82bdcc42 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1340 microversion: 2.20 time: 0.271582 Jun 07 08:38:43.770296 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 48/84] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:38:43 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1340 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:38:43.962768 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-ff2161a7-d4d1-4d7c-a226-34f05b975a73 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae58168dadc845daa0958cf975a41abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ee9298ae04230979b6a62d24be0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:43.971624 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-ff2161a7-d4d1-4d7c-a226-34f05b975a73 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77" status: 200 len: 1315 microversion: 2.1 time: 0.261975 Jun 07 08:38:43.972198 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 37/85] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:43 2022] GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:44.554391 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-bb9ffadf-eb03-4569-a678-2211cef11b90 tempest-VolumesNegativeTest-1544195977 tempest-VolumesNegativeTest-1544195977-project] Action: 'create', calling method: .version_select at 0x7f7fee07bb80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-567109451", "metadata": {"Type": "work"}}} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:38:44.564456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-bb9ffadf-eb03-4569-a678-2211cef11b90 tempest-VolumesNegativeTest-1544195977 tempest-VolumesNegativeTest-1544195977-project] Request method failure captured: Jun 07 08:38:44.564456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 07 08:38:44.564456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept: application/json Jun 07 08:38:44.564456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept-Encoding: identity Jun 07 08:38:44.564456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Connection: close Jun 07 08:38:44.564456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Length: 121 Jun 07 08:38:44.564456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Type: application/json Jun 07 08:38:44.564456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Host: 10.222.0.17 Jun 07 08:38:44.564456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Openstack-System-Scope: None Jun 07 08:38:44.564456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: User-Agent: python-urllib3/1.26.9 Jun 07 08:38:44.564456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Auth-Token: gAAAAABinw6U2y7XpSU0c3pxWoOj8G5l3R13w2jo0A9RRW4bV8nxC3-Xax0jYez5ylLezlVZFt7sSXT-7D9aNObNt9Hhqw08GXDYWibPOVxXkHvD_m3Cwcc4abNEjIPtVffH42SjmNvBNyL1l88pHbUVKZQema-PjwDaJBRroK0MW6BjKUgGh58 Jun 07 08:38:44.564456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Id: None Jun 07 08:38:44.564456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Name: None Jun 07 08:38:44.564456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Identity-Status: Confirmed Jun 07 08:38:44.564456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Is-Admin-Project: True Jun 07 08:38:44.564456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Id: default Jun 07 08:38:44.564456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Name: Default Jun 07 08:38:44.564456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Id: 1921d0de571f454eb510fbee6aa30eb7 Jun 07 08:38:44.564456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Name: tempest-VolumesNegativeTest-1544195977 Jun 07 08:38:44.564456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Role: reader,member Jun 07 08:38:44.564456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Roles: reader,member Jun 07 08:38:44.567218 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1921d0de571f454eb510fbee6aa30eb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1921d0de571f454eb510fbee6aa30eb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1921d0de571f454eb510fbee6aa30eb7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1921d0de571f454eb510fbee6aa30eb7"}]}] Jun 07 08:38:44.567218 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant: tempest-VolumesNegativeTest-1544195977 Jun 07 08:38:44.567218 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Id: 1921d0de571f454eb510fbee6aa30eb7 Jun 07 08:38:44.567218 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Name: tempest-VolumesNegativeTest-1544195977 Jun 07 08:38:44.567218 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User: tempest-VolumesNegativeTest-1544195977-project Jun 07 08:38:44.567218 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Id: default Jun 07 08:38:44.567218 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Name: Default Jun 07 08:38:44.567218 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Id: 059d623a01ea48d79fb6fbebdb92551f Jun 07 08:38:44.567218 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Name: tempest-VolumesNegativeTest-1544195977-project Jun 07 08:38:44.567218 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Jun 07 08:38:44.567218 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-567109451", "metadata": {"Type": "work"}}} Jun 07 08:38:44.567218 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: method: Jun 07 08:38:44.567218 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 07 08:38:44.568659 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-567109451', 'metadata': {'Type': 'work'}}}} Jun 07 08:38:44.568659 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:38:44.568659 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:44.568659 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 07 08:38:44.568659 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 07 08:38:44.568659 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 07 08:38:44.568659 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise error Jun 07 08:38:44.568659 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 07 08:38:44.568659 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:44.568659 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 07 08:38:44.568659 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 07 08:38:44.568659 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:44.568659 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 07 08:38:44.568659 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi '#$%' Jun 07 08:38:44.568659 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:44.568659 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:38:44.568659 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:44.568659 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:44.568659 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:38:44.568659 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:38:44.568659 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:38:44.568659 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:38:44.570846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 08:38:44.570846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 08:38:44.570846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:38:44.570846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:38:44.570846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 07 08:38:44.570846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 07 08:38:44.570846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 07 08:38:44.570846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 07 08:38:44.570846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 07 08:38:44.570846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 07 08:38:44.570846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 07 08:38:44.570846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:44.570846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:38:44.570846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:44.570846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:44.570846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:38:44.570846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:38:44.570846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 07 08:38:44.570846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 07 08:38:44.572279 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 07 08:38:44.572279 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:44.572279 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-bb9ffadf-eb03-4569-a678-2211cef11b90 tempest-VolumesNegativeTest-1544195977 tempest-VolumesNegativeTest-1544195977-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:38:44.572279 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-bb9ffadf-eb03-4569-a678-2211cef11b90 tempest-VolumesNegativeTest-1544195977 tempest-VolumesNegativeTest-1544195977-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.400272 Jun 07 08:38:44.572279 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 49/86] 10.222.0.17 () {60 vars in 1155 bytes} [Tue Jun 7 08:38:44 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 401 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 08:38:44.577896 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-3e67baac-e3bf-46fa-b9f9-a859bb218ced tempest-VolumesNegativeTest-1544195977 tempest-VolumesNegativeTest-1544195977-project] Action: 'create', calling method: .version_select at 0x7f7fed863430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-580987296", "metadata": {"Type": "work"}}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:38:44.591196 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-3e67baac-e3bf-46fa-b9f9-a859bb218ced tempest-VolumesNegativeTest-1544195977 tempest-VolumesNegativeTest-1544195977-project] Request method failure captured: Jun 07 08:38:44.591196 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 07 08:38:44.591196 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept: application/json Jun 07 08:38:44.591196 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept-Encoding: identity Jun 07 08:38:44.591196 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Connection: close Jun 07 08:38:44.591196 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Length: 119 Jun 07 08:38:44.591196 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Type: application/json Jun 07 08:38:44.591196 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Host: 10.222.0.17 Jun 07 08:38:44.591196 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Openstack-System-Scope: None Jun 07 08:38:44.591196 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: User-Agent: python-urllib3/1.26.9 Jun 07 08:38:44.591196 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Auth-Token: gAAAAABinw6U2y7XpSU0c3pxWoOj8G5l3R13w2jo0A9RRW4bV8nxC3-Xax0jYez5ylLezlVZFt7sSXT-7D9aNObNt9Hhqw08GXDYWibPOVxXkHvD_m3Cwcc4abNEjIPtVffH42SjmNvBNyL1l88pHbUVKZQema-PjwDaJBRroK0MW6BjKUgGh58 Jun 07 08:38:44.591196 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Id: None Jun 07 08:38:44.591196 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Name: None Jun 07 08:38:44.591196 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Identity-Status: Confirmed Jun 07 08:38:44.591196 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Is-Admin-Project: True Jun 07 08:38:44.591196 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Id: default Jun 07 08:38:44.591196 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Name: Default Jun 07 08:38:44.591196 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Id: 1921d0de571f454eb510fbee6aa30eb7 Jun 07 08:38:44.591196 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Name: tempest-VolumesNegativeTest-1544195977 Jun 07 08:38:44.591196 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Role: reader,member Jun 07 08:38:44.591196 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Roles: reader,member Jun 07 08:38:44.593768 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1921d0de571f454eb510fbee6aa30eb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1921d0de571f454eb510fbee6aa30eb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1921d0de571f454eb510fbee6aa30eb7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1921d0de571f454eb510fbee6aa30eb7"}]}] Jun 07 08:38:44.593768 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant: tempest-VolumesNegativeTest-1544195977 Jun 07 08:38:44.593768 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Id: 1921d0de571f454eb510fbee6aa30eb7 Jun 07 08:38:44.593768 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Name: tempest-VolumesNegativeTest-1544195977 Jun 07 08:38:44.593768 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User: tempest-VolumesNegativeTest-1544195977-project Jun 07 08:38:44.593768 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Id: default Jun 07 08:38:44.593768 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Name: Default Jun 07 08:38:44.593768 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Id: 059d623a01ea48d79fb6fbebdb92551f Jun 07 08:38:44.593768 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Name: tempest-VolumesNegativeTest-1544195977-project Jun 07 08:38:44.593768 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Jun 07 08:38:44.593768 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-580987296", "metadata": {"Type": "work"}}} Jun 07 08:38:44.593768 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: method: Jun 07 08:38:44.593768 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 07 08:38:44.595345 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-580987296', 'metadata': {'Type': 'work'}}}} Jun 07 08:38:44.595345 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:38:44.595345 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:44.595345 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 07 08:38:44.595345 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 07 08:38:44.595345 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 07 08:38:44.595345 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise error Jun 07 08:38:44.595345 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 07 08:38:44.595345 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:38:44.595345 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 07 08:38:44.595345 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 07 08:38:44.595345 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:38:44.595345 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 07 08:38:44.595345 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi '0' Jun 07 08:38:44.595345 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:38:44.595345 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:38:44.595345 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:38:44.595345 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:44.595345 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:38:44.595345 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:38:44.595345 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:38:44.595345 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:38:44.598752 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 08:38:44.598752 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 08:38:44.598752 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:38:44.598752 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:38:44.598752 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 07 08:38:44.598752 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 07 08:38:44.598752 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 07 08:38:44.598752 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 07 08:38:44.598752 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 07 08:38:44.598752 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 07 08:38:44.598752 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 07 08:38:44.598752 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:38:44.598752 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:38:44.598752 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:38:44.598752 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:44.598752 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:38:44.598752 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:38:44.598752 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 07 08:38:44.598752 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 07 08:38:44.600983 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 07 08:38:44.600983 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:38:44.600983 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-3e67baac-e3bf-46fa-b9f9-a859bb218ced tempest-VolumesNegativeTest-1544195977 tempest-VolumesNegativeTest-1544195977-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:38:44.600983 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-3e67baac-e3bf-46fa-b9f9-a859bb218ced tempest-VolumesNegativeTest-1544195977 tempest-VolumesNegativeTest-1544195977-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010550 Jun 07 08:38:44.600983 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 38/87] 10.222.0.17 () {60 vars in 1155 bytes} [Tue Jun 7 08:38:44 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 08:38:44.607476 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-974b8b05-31a2-4d14-b0e6-dafb6c0d9998 tempest-VolumesNegativeTest-1544195977 tempest-VolumesNegativeTest-1544195977-project] Action: 'create', calling method: .version_select at 0x7f7fee134160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-454473252", "metadata": {"Type": "work"}}} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:38:44.607476 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-974b8b05-31a2-4d14-b0e6-dafb6c0d9998 tempest-VolumesNegativeTest-1544195977 tempest-VolumesNegativeTest-1544195977-project] Request method failure captured: Jun 07 08:38:44.607476 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 07 08:38:44.607476 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept: application/json Jun 07 08:38:44.607476 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept-Encoding: identity Jun 07 08:38:44.607476 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Connection: close Jun 07 08:38:44.607476 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Length: 118 Jun 07 08:38:44.607476 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Type: application/json Jun 07 08:38:44.607476 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Host: 10.222.0.17 Jun 07 08:38:44.607476 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Openstack-System-Scope: None Jun 07 08:38:44.607476 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: User-Agent: python-urllib3/1.26.9 Jun 07 08:38:44.607476 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Auth-Token: gAAAAABinw6U2y7XpSU0c3pxWoOj8G5l3R13w2jo0A9RRW4bV8nxC3-Xax0jYez5ylLezlVZFt7sSXT-7D9aNObNt9Hhqw08GXDYWibPOVxXkHvD_m3Cwcc4abNEjIPtVffH42SjmNvBNyL1l88pHbUVKZQema-PjwDaJBRroK0MW6BjKUgGh58 Jun 07 08:38:44.607476 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Id: None Jun 07 08:38:44.607476 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Name: None Jun 07 08:38:44.607476 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Identity-Status: Confirmed Jun 07 08:38:44.607476 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Is-Admin-Project: True Jun 07 08:38:44.607476 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Id: default Jun 07 08:38:44.607476 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Name: Default Jun 07 08:38:44.607476 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Id: 1921d0de571f454eb510fbee6aa30eb7 Jun 07 08:38:44.607476 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Name: tempest-VolumesNegativeTest-1544195977 Jun 07 08:38:44.607476 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Role: reader,member Jun 07 08:38:44.607476 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Roles: reader,member Jun 07 08:38:44.617347 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1921d0de571f454eb510fbee6aa30eb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1921d0de571f454eb510fbee6aa30eb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1921d0de571f454eb510fbee6aa30eb7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1921d0de571f454eb510fbee6aa30eb7"}]}] Jun 07 08:38:44.617347 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant: tempest-VolumesNegativeTest-1544195977 Jun 07 08:38:44.617347 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Id: 1921d0de571f454eb510fbee6aa30eb7 Jun 07 08:38:44.617347 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Name: tempest-VolumesNegativeTest-1544195977 Jun 07 08:38:44.617347 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User: tempest-VolumesNegativeTest-1544195977-project Jun 07 08:38:44.617347 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Id: default Jun 07 08:38:44.617347 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Name: Default Jun 07 08:38:44.617347 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Id: 059d623a01ea48d79fb6fbebdb92551f Jun 07 08:38:44.617347 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Name: tempest-VolumesNegativeTest-1544195977-project Jun 07 08:38:44.617347 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Jun 07 08:38:44.617347 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-454473252", "metadata": {"Type": "work"}}} Jun 07 08:38:44.617347 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: method: Jun 07 08:38:44.617347 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 07 08:38:44.619960 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-454473252', 'metadata': {'Type': 'work'}}}} Jun 07 08:38:44.619960 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:38:44.619960 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:44.619960 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 07 08:38:44.619960 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 07 08:38:44.619960 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 07 08:38:44.619960 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise error Jun 07 08:38:44.619960 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 07 08:38:44.619960 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:44.619960 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 07 08:38:44.619960 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 07 08:38:44.619960 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:44.619960 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 07 08:38:44.619960 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi '' Jun 07 08:38:44.619960 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:44.619960 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:38:44.619960 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:44.619960 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:44.619960 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:38:44.619960 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:38:44.619960 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:38:44.619960 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:38:44.622668 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 08:38:44.622668 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 08:38:44.622668 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:38:44.622668 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:38:44.622668 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 07 08:38:44.622668 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 07 08:38:44.622668 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 07 08:38:44.622668 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 07 08:38:44.622668 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 07 08:38:44.622668 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 07 08:38:44.622668 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 07 08:38:44.622668 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:44.622668 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:38:44.622668 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:44.622668 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:44.622668 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:38:44.622668 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:38:44.622668 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 07 08:38:44.622668 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 07 08:38:44.625984 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 07 08:38:44.625984 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:44.625984 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-974b8b05-31a2-4d14-b0e6-dafb6c0d9998 tempest-VolumesNegativeTest-1544195977 tempest-VolumesNegativeTest-1544195977-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:38:44.625984 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-974b8b05-31a2-4d14-b0e6-dafb6c0d9998 tempest-VolumesNegativeTest-1544195977 tempest-VolumesNegativeTest-1544195977-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008163 Jun 07 08:38:44.625984 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 50/88] 10.222.0.17 () {60 vars in 1155 bytes} [Tue Jun 7 08:38:44 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 08:38:44.626762 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-fcc26276-425a-4a82-bc6b-6eb2d46927fa tempest-VolumesNegativeTest-1544195977 tempest-VolumesNegativeTest-1544195977-project] Calling method '.version_select at 0x7f7fee8f0ee0>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:44.687159 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.wsgi [None req-fcc26276-425a-4a82-bc6b-6eb2d46927fa tempest-VolumesNegativeTest-1544195977 tempest-VolumesNegativeTest-1544195977-project] HTTP exception thrown: Volume tempest-invalid-1689073995 could not be found. Jun 07 08:38:44.694564 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-fcc26276-425a-4a82-bc6b-6eb2d46927fa tempest-VolumesNegativeTest-1544195977 tempest-VolumesNegativeTest-1544195977-project] Request method failure captured: Jun 07 08:38:44.694564 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1689073995 HTTP/1.1 Jun 07 08:38:44.694564 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept: application/json Jun 07 08:38:44.694564 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept-Encoding: identity Jun 07 08:38:44.694564 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Connection: close Jun 07 08:38:44.694564 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Length: 0 Jun 07 08:38:44.694564 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Type: application/json Jun 07 08:38:44.694564 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Host: 10.222.0.17 Jun 07 08:38:44.694564 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Openstack-System-Scope: None Jun 07 08:38:44.694564 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: User-Agent: python-urllib3/1.26.9 Jun 07 08:38:44.694564 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Auth-Token: gAAAAABinw6U2y7XpSU0c3pxWoOj8G5l3R13w2jo0A9RRW4bV8nxC3-Xax0jYez5ylLezlVZFt7sSXT-7D9aNObNt9Hhqw08GXDYWibPOVxXkHvD_m3Cwcc4abNEjIPtVffH42SjmNvBNyL1l88pHbUVKZQema-PjwDaJBRroK0MW6BjKUgGh58 Jun 07 08:38:44.694564 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Id: None Jun 07 08:38:44.694564 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Name: None Jun 07 08:38:44.694564 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Identity-Status: Confirmed Jun 07 08:38:44.694564 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Is-Admin-Project: True Jun 07 08:38:44.694564 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Id: default Jun 07 08:38:44.694564 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Name: Default Jun 07 08:38:44.694564 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Id: 1921d0de571f454eb510fbee6aa30eb7 Jun 07 08:38:44.694564 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Name: tempest-VolumesNegativeTest-1544195977 Jun 07 08:38:44.694564 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Role: reader,member Jun 07 08:38:44.694564 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Roles: reader,member Jun 07 08:38:44.697195 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1921d0de571f454eb510fbee6aa30eb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1921d0de571f454eb510fbee6aa30eb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1921d0de571f454eb510fbee6aa30eb7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1921d0de571f454eb510fbee6aa30eb7"}]}] Jun 07 08:38:44.697195 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant: tempest-VolumesNegativeTest-1544195977 Jun 07 08:38:44.697195 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Id: 1921d0de571f454eb510fbee6aa30eb7 Jun 07 08:38:44.697195 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Name: tempest-VolumesNegativeTest-1544195977 Jun 07 08:38:44.697195 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User: tempest-VolumesNegativeTest-1544195977-project Jun 07 08:38:44.697195 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Id: default Jun 07 08:38:44.697195 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Name: Default Jun 07 08:38:44.697195 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Id: 059d623a01ea48d79fb6fbebdb92551f Jun 07 08:38:44.697195 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Name: tempest-VolumesNegativeTest-1544195977-project Jun 07 08:38:44.697195 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: method: Jun 07 08:38:44.697195 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: exception: Volume tempest-invalid-1689073995 could not be found. Jun 07 08:38:44.697195 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: action_args: {'id': 'tempest-invalid-1689073995'} Jun 07 08:38:44.697195 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:38:44.698692 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:44.698692 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 08:38:44.698692 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 08:38:44.698692 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 08:38:44.698692 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 08:38:44.698692 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 08:38:44.698692 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 08:38:44.698692 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 08:38:44.698692 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 08:38:44.698692 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 08:38:44.698692 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 08:38:44.698692 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 08:38:44.698692 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 08:38:44.698692 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 08:38:44.698692 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 08:38:44.698692 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1689073995 could not be found. (HTTP 404) (Request-ID: req-3ec3eea1-9295-43d7-8502-c0f1cd0e0bba) Jun 07 08:38:44.698692 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:38:44.698692 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:38:44.698692 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:38:44.701296 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:44.701296 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 07 08:38:44.701296 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 07 08:38:44.701296 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 08:38:44.701296 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 08:38:44.701296 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 08:38:44.701296 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 08:38:44.701296 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 08:38:44.701296 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 08:38:44.701296 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 08:38:44.701296 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 08:38:44.701296 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 08:38:44.701296 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 08:38:44.701296 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 08:38:44.701296 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 08:38:44.701296 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 08:38:44.701296 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 08:38:44.701296 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 08:38:44.701296 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 08:38:44.703498 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 08:38:44.703498 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 08:38:44.703498 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 08:38:44.703498 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 08:38:44.703498 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1689073995 could not be found. Jun 07 08:38:44.703498 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:38:44.703498 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:38:44.703498 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:38:44.703498 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:44.703498 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:38:44.703498 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:38:44.703498 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:38:44.703498 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:38:44.703498 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 08:38:44.703498 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 08:38:44.703498 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:38:44.703498 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:38:44.703498 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 07 08:38:44.703498 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:38:44.703498 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1689073995 could not be found. Jun 07 08:38:44.706932 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:38:44.706932 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:38:44.706932 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:38:44.706932 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:44.706932 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:38:44.706932 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:38:44.706932 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:38:44.706932 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:38:44.706932 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1689073995 could not be found. Jun 07 08:38:44.706932 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:38:44.710285 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-fcc26276-425a-4a82-bc6b-6eb2d46927fa tempest-VolumesNegativeTest-1544195977 tempest-VolumesNegativeTest-1544195977-project] Returning 404 to user: Volume tempest-invalid-1689073995 could not be found. {{(pid=129726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:38:44.710830 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-fcc26276-425a-4a82-bc6b-6eb2d46927fa tempest-VolumesNegativeTest-1544195977 tempest-VolumesNegativeTest-1544195977-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1689073995" status: 404 len: 99 microversion: 2.1 time: 0.100664 Jun 07 08:38:44.721405 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 39/89] 10.222.0.17 () {58 vars in 1217 bytes} [Tue Jun 7 08:38:44 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1689073995 => generated 99 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 07 08:38:44.721690 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-f8635728-030d-4722-a183-bcbc67f49b28 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:44.726291 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-f8635728-030d-4722-a183-bcbc67f49b28 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:44.739379 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-ac29628f-984e-49d7-ad6e-00680bb5280a tempest-VolumesNegativeTest-1544195977 tempest-VolumesNegativeTest-1544195977-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.016311 Jun 07 08:38:44.748048 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f8635728-030d-4722-a183-bcbc67f49b28 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:44.748297 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 40/90] 10.222.0.17 () {58 vars in 1139 bytes} [Tue Jun 7 08:38:44 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 21 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 07 08:38:44.748449 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f8635728-030d-4722-a183-bcbc67f49b28 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:44.748449 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f8635728-030d-4722-a183-bcbc67f49b28 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:44.749630 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f8635728-030d-4722-a183-bcbc67f49b28 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:44.766454 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-ecd88cd8-22d3-4f24-a724-3d3eb4cf9fd6 tempest-VolumesNegativeTest-1544195977 tempest-VolumesNegativeTest-1544195977-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.014814 Jun 07 08:38:44.776524 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 41/91] 10.222.0.17 () {58 vars in 1136 bytes} [Tue Jun 7 08:38:44 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 07 08:38:44.788245 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-0b2a3812-5510-472e-98be-29af64c70010 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:44.792475 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-0b2a3812-5510-472e-98be-29af64c70010 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:44.823600 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0b2a3812-5510-472e-98be-29af64c70010 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:44.824436 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0b2a3812-5510-472e-98be-29af64c70010 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:44.827159 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0b2a3812-5510-472e-98be-29af64c70010 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:44.837223 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0b2a3812-5510-472e-98be-29af64c70010 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:45.028888 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-f8635728-030d-4722-a183-bcbc67f49b28 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:45.041095 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-f8635728-030d-4722-a183-bcbc67f49b28 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1322 microversion: 2.1 time: 0.328462 Jun 07 08:38:45.041988 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 51/92] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:44 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:45.048195 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-936123c3-2bab-436a-b7d4-958084c16ee2 tempest-VolumesNegativeTest-1544195977 tempest-VolumesNegativeTest-1544195977-project] Calling method '.version_select at 0x7f7fee05bc10>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:45.094648 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.wsgi [None req-936123c3-2bab-436a-b7d4-958084c16ee2 tempest-VolumesNegativeTest-1544195977 tempest-VolumesNegativeTest-1544195977-project] HTTP exception thrown: Volume e58c70d1-2ae3-4a38-8a4d-dc9ed5a218e1 could not be found. Jun 07 08:38:45.096465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-936123c3-2bab-436a-b7d4-958084c16ee2 tempest-VolumesNegativeTest-1544195977 tempest-VolumesNegativeTest-1544195977-project] Request method failure captured: Jun 07 08:38:45.096465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: request: DELETE /compute/v2.1/os-volumes/e58c70d1-2ae3-4a38-8a4d-dc9ed5a218e1 HTTP/1.1 Jun 07 08:38:45.096465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept: application/json Jun 07 08:38:45.096465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept-Encoding: identity Jun 07 08:38:45.096465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Connection: close Jun 07 08:38:45.096465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Length: 0 Jun 07 08:38:45.096465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Type: application/json Jun 07 08:38:45.096465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Host: 10.222.0.17 Jun 07 08:38:45.096465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Openstack-System-Scope: None Jun 07 08:38:45.096465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: User-Agent: python-urllib3/1.26.9 Jun 07 08:38:45.096465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Auth-Token: gAAAAABinw6U2y7XpSU0c3pxWoOj8G5l3R13w2jo0A9RRW4bV8nxC3-Xax0jYez5ylLezlVZFt7sSXT-7D9aNObNt9Hhqw08GXDYWibPOVxXkHvD_m3Cwcc4abNEjIPtVffH42SjmNvBNyL1l88pHbUVKZQema-PjwDaJBRroK0MW6BjKUgGh58 Jun 07 08:38:45.096465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Id: None Jun 07 08:38:45.096465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Name: None Jun 07 08:38:45.096465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Identity-Status: Confirmed Jun 07 08:38:45.096465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Is-Admin-Project: True Jun 07 08:38:45.096465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Id: default Jun 07 08:38:45.096465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Name: Default Jun 07 08:38:45.096465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Id: 1921d0de571f454eb510fbee6aa30eb7 Jun 07 08:38:45.096465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Name: tempest-VolumesNegativeTest-1544195977 Jun 07 08:38:45.096465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Role: reader,member Jun 07 08:38:45.096465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Roles: reader,member Jun 07 08:38:45.097642 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1921d0de571f454eb510fbee6aa30eb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1921d0de571f454eb510fbee6aa30eb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1921d0de571f454eb510fbee6aa30eb7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1921d0de571f454eb510fbee6aa30eb7"}]}] Jun 07 08:38:45.097642 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant: tempest-VolumesNegativeTest-1544195977 Jun 07 08:38:45.097642 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Id: 1921d0de571f454eb510fbee6aa30eb7 Jun 07 08:38:45.097642 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Name: tempest-VolumesNegativeTest-1544195977 Jun 07 08:38:45.097642 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User: tempest-VolumesNegativeTest-1544195977-project Jun 07 08:38:45.097642 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Id: default Jun 07 08:38:45.097642 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Name: Default Jun 07 08:38:45.097642 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Id: 059d623a01ea48d79fb6fbebdb92551f Jun 07 08:38:45.097642 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Name: tempest-VolumesNegativeTest-1544195977-project Jun 07 08:38:45.097642 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: method: Jun 07 08:38:45.097642 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: exception: Volume e58c70d1-2ae3-4a38-8a4d-dc9ed5a218e1 could not be found. Jun 07 08:38:45.097642 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: action_args: {'id': 'e58c70d1-2ae3-4a38-8a4d-dc9ed5a218e1'} Jun 07 08:38:45.097642 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:38:45.098333 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:45.098333 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 08:38:45.098333 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 08:38:45.098333 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 08:38:45.098333 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 08:38:45.098333 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 08:38:45.098333 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 08:38:45.098333 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 08:38:45.098333 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 08:38:45.098333 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 08:38:45.098333 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 08:38:45.098333 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 08:38:45.098333 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 08:38:45.098333 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 08:38:45.098333 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 08:38:45.098333 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e58c70d1-2ae3-4a38-8a4d-dc9ed5a218e1 could not be found. (HTTP 404) (Request-ID: req-fe3cbd9c-d848-403f-8eb9-d494f73237d5) Jun 07 08:38:45.098333 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:45.098333 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:38:45.098333 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:45.099845 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:45.099845 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 07 08:38:45.099845 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 07 08:38:45.099845 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 08:38:45.099845 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 08:38:45.099845 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 08:38:45.099845 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 08:38:45.099845 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 08:38:45.099845 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 08:38:45.099845 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 08:38:45.099845 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 08:38:45.099845 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 07 08:38:45.099845 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 07 08:38:45.099845 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 07 08:38:45.099845 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 07 08:38:45.099845 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 07 08:38:45.099845 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 07 08:38:45.099845 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 07 08:38:45.099845 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 07 08:38:45.102694 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 08:38:45.102694 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 08:38:45.102694 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 08:38:45.102694 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 08:38:45.102694 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e58c70d1-2ae3-4a38-8a4d-dc9ed5a218e1 could not be found. Jun 07 08:38:45.102694 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:45.102694 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:38:45.102694 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:45.102694 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:45.102694 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:38:45.102694 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:38:45.102694 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:38:45.102694 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:38:45.102694 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 08:38:45.102694 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 08:38:45.102694 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:38:45.102694 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:38:45.102694 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 07 08:38:45.102694 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:38:45.104908 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e58c70d1-2ae3-4a38-8a4d-dc9ed5a218e1 could not be found. Jun 07 08:38:45.104908 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:45.104908 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:38:45.104908 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:45.104908 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:45.104908 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:38:45.104908 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:38:45.104908 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:38:45.104908 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:38:45.104908 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e58c70d1-2ae3-4a38-8a4d-dc9ed5a218e1 could not be found. Jun 07 08:38:45.104908 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:38:45.118216 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-936123c3-2bab-436a-b7d4-958084c16ee2 tempest-VolumesNegativeTest-1544195977 tempest-VolumesNegativeTest-1544195977-project] Returning 404 to user: Volume e58c70d1-2ae3-4a38-8a4d-dc9ed5a218e1 could not be found. {{(pid=129725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:38:45.118216 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-936123c3-2bab-436a-b7d4-958084c16ee2 tempest-VolumesNegativeTest-1544195977 tempest-VolumesNegativeTest-1544195977-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/e58c70d1-2ae3-4a38-8a4d-dc9ed5a218e1" status: 404 len: 109 microversion: 2.1 time: 0.067256 Jun 07 08:38:45.118216 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 52/93] 10.222.0.17 () {58 vars in 1247 bytes} [Tue Jun 7 08:38:45 2022] DELETE /compute/v2.1/os-volumes/e58c70d1-2ae3-4a38-8a4d-dc9ed5a218e1 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:38:45.123632 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-f56862ec-b34d-4858-9d7a-cfbd3f95780b tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:45.124536 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-f56862ec-b34d-4858-9d7a-cfbd3f95780b tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:45.144517 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f56862ec-b34d-4858-9d7a-cfbd3f95780b tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:45.146005 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f56862ec-b34d-4858-9d7a-cfbd3f95780b tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:45.147189 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f56862ec-b34d-4858-9d7a-cfbd3f95780b tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:45.147984 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f56862ec-b34d-4858-9d7a-cfbd3f95780b tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:45.252239 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-0b2a3812-5510-472e-98be-29af64c70010 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:45.262116 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-0b2a3812-5510-472e-98be-29af64c70010 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:45.264241 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-0b2a3812-5510-472e-98be-29af64c70010 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:45.265895 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-0b2a3812-5510-472e-98be-29af64c70010 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1408 microversion: 2.20 time: 0.490768 Jun 07 08:38:45.277053 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 42/94] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:38:44 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1408 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:38:45.287477 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-09463c03-2767-4fc7-b8fe-dca38f5aef79 tempest-VolumesNegativeTest-1544195977 tempest-VolumesNegativeTest-1544195977-project] Calling method '.version_select at 0x7f7fed853ee0>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:45.317821 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.wsgi [None req-09463c03-2767-4fc7-b8fe-dca38f5aef79 tempest-VolumesNegativeTest-1544195977 tempest-VolumesNegativeTest-1544195977-project] HTTP exception thrown: Volume d493b151-d81f-4aba-9d3c-85cf71e2e341 could not be found. Jun 07 08:38:45.319869 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-09463c03-2767-4fc7-b8fe-dca38f5aef79 tempest-VolumesNegativeTest-1544195977 tempest-VolumesNegativeTest-1544195977-project] Request method failure captured: Jun 07 08:38:45.319869 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: request: GET /compute/v2.1/os-volumes/d493b151-d81f-4aba-9d3c-85cf71e2e341 HTTP/1.1 Jun 07 08:38:45.319869 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept: application/json Jun 07 08:38:45.319869 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept-Encoding: identity Jun 07 08:38:45.319869 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Connection: close Jun 07 08:38:45.319869 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Length: 0 Jun 07 08:38:45.319869 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Type: application/json Jun 07 08:38:45.319869 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Host: 10.222.0.17 Jun 07 08:38:45.319869 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Openstack-System-Scope: None Jun 07 08:38:45.319869 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: User-Agent: python-urllib3/1.26.9 Jun 07 08:38:45.319869 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Auth-Token: gAAAAABinw6U2y7XpSU0c3pxWoOj8G5l3R13w2jo0A9RRW4bV8nxC3-Xax0jYez5ylLezlVZFt7sSXT-7D9aNObNt9Hhqw08GXDYWibPOVxXkHvD_m3Cwcc4abNEjIPtVffH42SjmNvBNyL1l88pHbUVKZQema-PjwDaJBRroK0MW6BjKUgGh58 Jun 07 08:38:45.319869 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Id: None Jun 07 08:38:45.319869 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Name: None Jun 07 08:38:45.319869 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Identity-Status: Confirmed Jun 07 08:38:45.319869 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Is-Admin-Project: True Jun 07 08:38:45.319869 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Id: default Jun 07 08:38:45.319869 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Name: Default Jun 07 08:38:45.319869 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Id: 1921d0de571f454eb510fbee6aa30eb7 Jun 07 08:38:45.319869 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Name: tempest-VolumesNegativeTest-1544195977 Jun 07 08:38:45.319869 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Role: reader,member Jun 07 08:38:45.319869 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Roles: reader,member Jun 07 08:38:45.321336 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1921d0de571f454eb510fbee6aa30eb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1921d0de571f454eb510fbee6aa30eb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1921d0de571f454eb510fbee6aa30eb7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1921d0de571f454eb510fbee6aa30eb7"}]}] Jun 07 08:38:45.321336 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant: tempest-VolumesNegativeTest-1544195977 Jun 07 08:38:45.321336 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Id: 1921d0de571f454eb510fbee6aa30eb7 Jun 07 08:38:45.321336 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Name: tempest-VolumesNegativeTest-1544195977 Jun 07 08:38:45.321336 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User: tempest-VolumesNegativeTest-1544195977-project Jun 07 08:38:45.321336 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Id: default Jun 07 08:38:45.321336 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Name: Default Jun 07 08:38:45.321336 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Id: 059d623a01ea48d79fb6fbebdb92551f Jun 07 08:38:45.321336 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Name: tempest-VolumesNegativeTest-1544195977-project Jun 07 08:38:45.321336 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: method: Jun 07 08:38:45.321336 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: exception: Volume d493b151-d81f-4aba-9d3c-85cf71e2e341 could not be found. Jun 07 08:38:45.321336 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: action_args: {'id': 'd493b151-d81f-4aba-9d3c-85cf71e2e341'} Jun 07 08:38:45.321336 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:38:45.322222 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:45.322222 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 08:38:45.322222 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 08:38:45.322222 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 08:38:45.322222 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 08:38:45.322222 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 08:38:45.322222 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 08:38:45.322222 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 08:38:45.322222 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 08:38:45.322222 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 08:38:45.322222 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 08:38:45.322222 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 08:38:45.322222 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 08:38:45.322222 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 08:38:45.322222 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 08:38:45.322222 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d493b151-d81f-4aba-9d3c-85cf71e2e341 could not be found. (HTTP 404) (Request-ID: req-c2f41a12-f4f4-45ce-a230-52a758af2a95) Jun 07 08:38:45.322222 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:38:45.322222 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:38:45.322222 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:38:45.323354 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:45.323354 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 07 08:38:45.323354 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 07 08:38:45.323354 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 07 08:38:45.323354 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 07 08:38:45.323354 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 07 08:38:45.323354 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 07 08:38:45.323354 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 07 08:38:45.323354 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 07 08:38:45.323354 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 07 08:38:45.323354 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 07 08:38:45.323354 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 07 08:38:45.323354 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 07 08:38:45.323354 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 07 08:38:45.323354 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 07 08:38:45.323354 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 07 08:38:45.323354 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 07 08:38:45.323354 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 07 08:38:45.323354 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 07 08:38:45.324373 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 07 08:38:45.324373 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 07 08:38:45.324373 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 07 08:38:45.324373 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 07 08:38:45.324373 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d493b151-d81f-4aba-9d3c-85cf71e2e341 could not be found. Jun 07 08:38:45.324373 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:38:45.324373 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:38:45.324373 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:38:45.324373 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:45.324373 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:38:45.324373 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:38:45.324373 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:38:45.324373 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:38:45.324373 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 07 08:38:45.324373 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 07 08:38:45.324373 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:38:45.324373 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:38:45.324373 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 07 08:38:45.324373 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:38:45.325327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d493b151-d81f-4aba-9d3c-85cf71e2e341 could not be found. Jun 07 08:38:45.325327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:38:45.325327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:38:45.325327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:38:45.325327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:38:45.325327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:38:45.325327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:38:45.325327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:38:45.325327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:38:45.325327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d493b151-d81f-4aba-9d3c-85cf71e2e341 could not be found. Jun 07 08:38:45.325327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:38:45.325327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-09463c03-2767-4fc7-b8fe-dca38f5aef79 tempest-VolumesNegativeTest-1544195977 tempest-VolumesNegativeTest-1544195977-project] Returning 404 to user: Volume d493b151-d81f-4aba-9d3c-85cf71e2e341 could not be found. {{(pid=129726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:38:45.325327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-09463c03-2767-4fc7-b8fe-dca38f5aef79 tempest-VolumesNegativeTest-1544195977 tempest-VolumesNegativeTest-1544195977-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/d493b151-d81f-4aba-9d3c-85cf71e2e341" status: 404 len: 109 microversion: 2.1 time: 0.043097 Jun 07 08:38:45.325327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 43/95] 10.222.0.17 () {58 vars in 1244 bytes} [Tue Jun 7 08:38:45 2022] GET /compute/v2.1/os-volumes/d493b151-d81f-4aba-9d3c-85cf71e2e341 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:38:45.347920 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-f56862ec-b34d-4858-9d7a-cfbd3f95780b tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae58168dadc845daa0958cf975a41abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ee9298ae04230979b6a62d24be0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:45.357838 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-f56862ec-b34d-4858-9d7a-cfbd3f95780b tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77" status: 200 len: 1315 microversion: 2.1 time: 0.245510 Jun 07 08:38:45.358783 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 53/96] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:45 2022] GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:46.056623 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell0:SELECT=8 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:38:46.057860 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell0:SELECT=26 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:38:46.066070 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-0a8edd20-a625-44eb-a3d5-db3e164f17d0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:46.066070 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-0a8edd20-a625-44eb-a3d5-db3e164f17d0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:46.071742 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0a8edd20-a625-44eb-a3d5-db3e164f17d0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:46.072420 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0a8edd20-a625-44eb-a3d5-db3e164f17d0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:46.074072 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0a8edd20-a625-44eb-a3d5-db3e164f17d0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:46.074736 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0a8edd20-a625-44eb-a3d5-db3e164f17d0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:46.169590 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-a885dcfa-5a19-4eea-a2ba-39c8b99be91a req-89ebb2b9-b740-4489-8588-26b156bfd5a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60630f0f-2831-479d-91fc-477b773635ad", "tag": "87bcbdda-ce88-44b8-b537-66a7d29ac04f"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:38:46.189725 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell0:SELECT=2 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:38:46.193541 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-a885dcfa-5a19-4eea-a2ba-39c8b99be91a req-89ebb2b9-b740-4489-8588-26b156bfd5a4 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:46.194734 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-a885dcfa-5a19-4eea-a2ba-39c8b99be91a req-89ebb2b9-b740-4489-8588-26b156bfd5a4 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:46.219223 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-a885dcfa-5a19-4eea-a2ba-39c8b99be91a req-89ebb2b9-b740-4489-8588-26b156bfd5a4 service nova] Creating event network-changed:87bcbdda-ce88-44b8-b537-66a7d29ac04f for instance 60630f0f-2831-479d-91fc-477b773635ad on hv-cinder-74014 Jun 07 08:38:46.229395 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-a885dcfa-5a19-4eea-a2ba-39c8b99be91a req-89ebb2b9-b740-4489-8588-26b156bfd5a4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062164 Jun 07 08:38:46.229395 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 54/97] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:38:46.287191 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-185a1af9-2075-41e7-9115-0340cf44c00b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:46.288265 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-185a1af9-2075-41e7-9115-0340cf44c00b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:46.295943 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-185a1af9-2075-41e7-9115-0340cf44c00b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:46.296613 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-185a1af9-2075-41e7-9115-0340cf44c00b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:46.297568 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-185a1af9-2075-41e7-9115-0340cf44c00b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:46.298671 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-185a1af9-2075-41e7-9115-0340cf44c00b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:46.469553 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-0a8edd20-a625-44eb-a3d5-db3e164f17d0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:46.480383 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-0a8edd20-a625-44eb-a3d5-db3e164f17d0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1322 microversion: 2.1 time: 0.425020 Jun 07 08:38:46.485522 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 44/98] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:46 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1322 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:46.495386 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-aea31cfb-6037-49f7-ab30-1769a53d08d4 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:46.498578 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-185a1af9-2075-41e7-9115-0340cf44c00b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:46.498719 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-aea31cfb-6037-49f7-ab30-1769a53d08d4 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:46.504870 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-aea31cfb-6037-49f7-ab30-1769a53d08d4 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:46.505177 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-185a1af9-2075-41e7-9115-0340cf44c00b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:46.505548 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-aea31cfb-6037-49f7-ab30-1769a53d08d4 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:46.507029 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-aea31cfb-6037-49f7-ab30-1769a53d08d4 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:46.507359 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-185a1af9-2075-41e7-9115-0340cf44c00b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:46.507671 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-aea31cfb-6037-49f7-ab30-1769a53d08d4 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:46.508984 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-185a1af9-2075-41e7-9115-0340cf44c00b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1408 microversion: 2.20 time: 0.228342 Jun 07 08:38:46.520074 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 55/99] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:38:46 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1408 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:38:46.896197 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-924f54d6-57e5-4217-8713-fe19346ba3b0 req-2ac8ebc1-017b-4826-bf16-12edbcd22023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e0e129e-3c0a-4372-a1e8-c508a3d27e77", "name": "network-vif-plugged", "status": "completed", "tag": "9603dafb-8d69-420d-920a-0f9c65f83393"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:38:46.913064 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-924f54d6-57e5-4217-8713-fe19346ba3b0 req-2ac8ebc1-017b-4826-bf16-12edbcd22023 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:46.913534 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-924f54d6-57e5-4217-8713-fe19346ba3b0 req-2ac8ebc1-017b-4826-bf16-12edbcd22023 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:46.951600 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-924f54d6-57e5-4217-8713-fe19346ba3b0 req-2ac8ebc1-017b-4826-bf16-12edbcd22023 service nova] Creating event network-vif-plugged:9603dafb-8d69-420d-920a-0f9c65f83393 for instance 6e0e129e-3c0a-4372-a1e8-c508a3d27e77 on hv-cinder-74014 Jun 07 08:38:46.966071 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-924f54d6-57e5-4217-8713-fe19346ba3b0 req-2ac8ebc1-017b-4826-bf16-12edbcd22023 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.261493 Jun 07 08:38:46.967516 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 56/100] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:38:46.993593 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-aea31cfb-6037-49f7-ab30-1769a53d08d4 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae58168dadc845daa0958cf975a41abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ee9298ae04230979b6a62d24be0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:47.008686 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-aea31cfb-6037-49f7-ab30-1769a53d08d4 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77" status: 200 len: 1315 microversion: 2.1 time: 0.521569 Jun 07 08:38:47.021014 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 45/101] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:46 2022] GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 => generated 1315 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:47.502964 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-a64d44bc-1049-4d05-a1da-112f1573fa97 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:47.504716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-a64d44bc-1049-4d05-a1da-112f1573fa97 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:47.521087 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell0:SELECT=18 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:38:47.528044 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-68ca8bc3-de65-4294-a662-f5f643999610 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:47.528654 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-68ca8bc3-de65-4294-a662-f5f643999610 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:47.546597 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-68ca8bc3-de65-4294-a662-f5f643999610 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:47.546931 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-68ca8bc3-de65-4294-a662-f5f643999610 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:47.548583 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-68ca8bc3-de65-4294-a662-f5f643999610 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:47.549058 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-68ca8bc3-de65-4294-a662-f5f643999610 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:47.552611 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a64d44bc-1049-4d05-a1da-112f1573fa97 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:47.553113 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a64d44bc-1049-4d05-a1da-112f1573fa97 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:47.555277 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a64d44bc-1049-4d05-a1da-112f1573fa97 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:47.555741 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a64d44bc-1049-4d05-a1da-112f1573fa97 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:47.846653 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-a64d44bc-1049-4d05-a1da-112f1573fa97 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:47.856782 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-a64d44bc-1049-4d05-a1da-112f1573fa97 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1322 microversion: 2.1 time: 0.362242 Jun 07 08:38:47.867200 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 57/102] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:47 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1322 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:47.868594 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-68ca8bc3-de65-4294-a662-f5f643999610 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:47.878423 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-68ca8bc3-de65-4294-a662-f5f643999610 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:47.880236 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-68ca8bc3-de65-4294-a662-f5f643999610 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:47.882162 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-68ca8bc3-de65-4294-a662-f5f643999610 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1408 microversion: 2.20 time: 0.357799 Jun 07 08:38:47.883938 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 46/103] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:38:47 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1408 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:38:48.027936 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-936ba962-3821-4170-a53c-1754b909d1f2 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:48.028804 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-936ba962-3821-4170-a53c-1754b909d1f2 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:48.035968 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-936ba962-3821-4170-a53c-1754b909d1f2 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:48.036476 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-936ba962-3821-4170-a53c-1754b909d1f2 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:48.040763 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-936ba962-3821-4170-a53c-1754b909d1f2 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:48.040968 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-936ba962-3821-4170-a53c-1754b909d1f2 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:48.210337 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-936ba962-3821-4170-a53c-1754b909d1f2 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae58168dadc845daa0958cf975a41abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ee9298ae04230979b6a62d24be0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:48.218491 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-936ba962-3821-4170-a53c-1754b909d1f2 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77" status: 200 len: 1315 microversion: 2.1 time: 0.195258 Jun 07 08:38:48.219795 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 58/104] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:48 2022] GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:48.874499 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-b437aada-5f8d-4be2-8d33-b64590628088 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:48.875256 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-b437aada-5f8d-4be2-8d33-b64590628088 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:48.882452 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b437aada-5f8d-4be2-8d33-b64590628088 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:48.883004 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b437aada-5f8d-4be2-8d33-b64590628088 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:48.883882 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b437aada-5f8d-4be2-8d33-b64590628088 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:48.884411 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b437aada-5f8d-4be2-8d33-b64590628088 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:48.903397 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-d34f4ac1-776d-429e-9c87-46e93fa22e6f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:48.904041 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-d34f4ac1-776d-429e-9c87-46e93fa22e6f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:48.912448 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d34f4ac1-776d-429e-9c87-46e93fa22e6f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:48.914606 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d34f4ac1-776d-429e-9c87-46e93fa22e6f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:48.914606 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d34f4ac1-776d-429e-9c87-46e93fa22e6f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:48.914606 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d34f4ac1-776d-429e-9c87-46e93fa22e6f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:49.086239 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-d34f4ac1-776d-429e-9c87-46e93fa22e6f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:49.086439 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-b437aada-5f8d-4be2-8d33-b64590628088 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:49.096486 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-d34f4ac1-776d-429e-9c87-46e93fa22e6f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:49.098026 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-d34f4ac1-776d-429e-9c87-46e93fa22e6f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:49.102066 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-d34f4ac1-776d-429e-9c87-46e93fa22e6f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1408 microversion: 2.20 time: 0.200669 Jun 07 08:38:49.102066 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 59/105] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:38:48 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1408 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:38:49.102344 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-b437aada-5f8d-4be2-8d33-b64590628088 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1322 microversion: 2.1 time: 0.229833 Jun 07 08:38:49.103325 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 47/106] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:48 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:49.104784 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-1c5eee8d-e324-41eb-a2cf-ef18443decb1 req-9b6b01b0-068c-4cac-a320-cd1f17b9d8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d40b0293-76f4-4ef2-9bfa-dda971ade7ea", "name": "network-vif-plugged", "status": "completed", "tag": "eb0afe08-4df3-4618-8c1a-99dacff66959"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:38:49.112936 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-1c5eee8d-e324-41eb-a2cf-ef18443decb1 req-9b6b01b0-068c-4cac-a320-cd1f17b9d8d7 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:49.113439 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-1c5eee8d-e324-41eb-a2cf-ef18443decb1 req-9b6b01b0-068c-4cac-a320-cd1f17b9d8d7 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:49.127020 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-1c5eee8d-e324-41eb-a2cf-ef18443decb1 req-9b6b01b0-068c-4cac-a320-cd1f17b9d8d7 service nova] Creating event network-vif-plugged:eb0afe08-4df3-4618-8c1a-99dacff66959 for instance d40b0293-76f4-4ef2-9bfa-dda971ade7ea on hv-cinder-74014 Jun 07 08:38:49.140204 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-1c5eee8d-e324-41eb-a2cf-ef18443decb1 req-9b6b01b0-068c-4cac-a320-cd1f17b9d8d7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031924 Jun 07 08:38:49.140204 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 60/107] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:38:49.236473 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-2bbb8151-2e70-47f8-b4a4-b135f77165dd tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:49.237260 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-2bbb8151-2e70-47f8-b4a4-b135f77165dd tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:49.246428 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2bbb8151-2e70-47f8-b4a4-b135f77165dd tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:49.247282 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2bbb8151-2e70-47f8-b4a4-b135f77165dd tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:49.250115 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2bbb8151-2e70-47f8-b4a4-b135f77165dd tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:49.250763 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2bbb8151-2e70-47f8-b4a4-b135f77165dd tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:49.419416 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-2bbb8151-2e70-47f8-b4a4-b135f77165dd tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae58168dadc845daa0958cf975a41abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ee9298ae04230979b6a62d24be0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:49.426979 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-2bbb8151-2e70-47f8-b4a4-b135f77165dd tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77" status: 200 len: 1315 microversion: 2.1 time: 0.195145 Jun 07 08:38:49.427852 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 48/108] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:49 2022] GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:50.118730 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-dea66012-6c7c-4d67-af13-fc5e3e32bd54 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:50.119336 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-462ca461-9ab8-4877-9ce5-af38afde43b8 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:50.119893 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-dea66012-6c7c-4d67-af13-fc5e3e32bd54 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:50.120010 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-462ca461-9ab8-4877-9ce5-af38afde43b8 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:50.125985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-462ca461-9ab8-4877-9ce5-af38afde43b8 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:50.126436 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-462ca461-9ab8-4877-9ce5-af38afde43b8 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:50.127264 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-462ca461-9ab8-4877-9ce5-af38afde43b8 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:50.127477 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-dea66012-6c7c-4d67-af13-fc5e3e32bd54 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:50.127784 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-462ca461-9ab8-4877-9ce5-af38afde43b8 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:50.127927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-dea66012-6c7c-4d67-af13-fc5e3e32bd54 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:50.128883 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-dea66012-6c7c-4d67-af13-fc5e3e32bd54 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:50.129363 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-dea66012-6c7c-4d67-af13-fc5e3e32bd54 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:50.297344 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-dea66012-6c7c-4d67-af13-fc5e3e32bd54 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:50.313662 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-dea66012-6c7c-4d67-af13-fc5e3e32bd54 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:50.315204 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-dea66012-6c7c-4d67-af13-fc5e3e32bd54 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:50.320206 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-dea66012-6c7c-4d67-af13-fc5e3e32bd54 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1408 microversion: 2.20 time: 0.202032 Jun 07 08:38:50.321603 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 61/109] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:38:50 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1408 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:38:50.332217 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-462ca461-9ab8-4877-9ce5-af38afde43b8 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:50.340322 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-462ca461-9ab8-4877-9ce5-af38afde43b8 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1322 microversion: 2.1 time: 0.225099 Jun 07 08:38:50.340897 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 49/110] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:50 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:38:50.445333 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-25093ee1-43cf-4823-b981-51b076b03ebe tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:50.445949 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-25093ee1-43cf-4823-b981-51b076b03ebe tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:50.452194 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-25093ee1-43cf-4823-b981-51b076b03ebe tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:50.452642 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-25093ee1-43cf-4823-b981-51b076b03ebe tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:50.453437 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-25093ee1-43cf-4823-b981-51b076b03ebe tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:50.453878 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-25093ee1-43cf-4823-b981-51b076b03ebe tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:50.621954 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-25093ee1-43cf-4823-b981-51b076b03ebe tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae58168dadc845daa0958cf975a41abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ee9298ae04230979b6a62d24be0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:50.633512 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-25093ee1-43cf-4823-b981-51b076b03ebe tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77" status: 200 len: 1315 microversion: 2.1 time: 0.192417 Jun 07 08:38:50.634390 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 62/111] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:50 2022] GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:51.150462 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-84983ee2-8acc-4557-9b4e-c0c040a40811 req-67ea8175-c225-4390-a74c-67918c88a745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b020097d-7d41-4338-a7a8-fe85f295435c", "name": "network-vif-plugged", "status": "completed", "tag": "98df96b5-be22-44b0-9b8f-858fd497d562"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:38:51.163158 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-84983ee2-8acc-4557-9b4e-c0c040a40811 req-67ea8175-c225-4390-a74c-67918c88a745 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:51.164656 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-84983ee2-8acc-4557-9b4e-c0c040a40811 req-67ea8175-c225-4390-a74c-67918c88a745 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:51.179065 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-84983ee2-8acc-4557-9b4e-c0c040a40811 req-67ea8175-c225-4390-a74c-67918c88a745 service nova] Creating event network-vif-plugged:98df96b5-be22-44b0-9b8f-858fd497d562 for instance b020097d-7d41-4338-a7a8-fe85f295435c on hv-cinder-74014 Jun 07 08:38:51.186759 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-84983ee2-8acc-4557-9b4e-c0c040a40811 req-67ea8175-c225-4390-a74c-67918c88a745 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040421 Jun 07 08:38:51.188085 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 50/112] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:38:51.338344 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-ec6dd285-6138-4daa-846a-74fc9b62b822 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:51.339754 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-ec6dd285-6138-4daa-846a-74fc9b62b822 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:51.359683 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-ff0e5192-b6c9-49c9-a189-4c5f49d667db tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:51.360743 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-ff0e5192-b6c9-49c9-a189-4c5f49d667db tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:51.366309 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ec6dd285-6138-4daa-846a-74fc9b62b822 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:51.366309 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ec6dd285-6138-4daa-846a-74fc9b62b822 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:51.366886 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ec6dd285-6138-4daa-846a-74fc9b62b822 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:51.371231 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ec6dd285-6138-4daa-846a-74fc9b62b822 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:51.375863 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ff0e5192-b6c9-49c9-a189-4c5f49d667db tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:51.376625 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ff0e5192-b6c9-49c9-a189-4c5f49d667db tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:51.394536 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ff0e5192-b6c9-49c9-a189-4c5f49d667db tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:51.395232 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ff0e5192-b6c9-49c9-a189-4c5f49d667db tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:51.556573 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-ec6dd285-6138-4daa-846a-74fc9b62b822 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:51.566245 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-ec6dd285-6138-4daa-846a-74fc9b62b822 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:51.568086 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-ec6dd285-6138-4daa-846a-74fc9b62b822 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:51.571085 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-ec6dd285-6138-4daa-846a-74fc9b62b822 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1408 microversion: 2.20 time: 0.237186 Jun 07 08:38:51.572096 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 63/113] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:38:51 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1408 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:38:51.636381 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-ff0e5192-b6c9-49c9-a189-4c5f49d667db tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:51.648291 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-ff0e5192-b6c9-49c9-a189-4c5f49d667db tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1322 microversion: 2.1 time: 0.293591 Jun 07 08:38:51.649154 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 51/114] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:51 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:51.650199 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-8c7a74a2-e716-4cbb-b8fa-a3e8267dc24d tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:51.650832 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-8c7a74a2-e716-4cbb-b8fa-a3e8267dc24d tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:51.656856 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8c7a74a2-e716-4cbb-b8fa-a3e8267dc24d tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:51.657349 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8c7a74a2-e716-4cbb-b8fa-a3e8267dc24d tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:51.658122 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8c7a74a2-e716-4cbb-b8fa-a3e8267dc24d tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:51.658718 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8c7a74a2-e716-4cbb-b8fa-a3e8267dc24d tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:51.865329 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-8c7a74a2-e716-4cbb-b8fa-a3e8267dc24d tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae58168dadc845daa0958cf975a41abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ee9298ae04230979b6a62d24be0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:51.874752 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-8c7a74a2-e716-4cbb-b8fa-a3e8267dc24d tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77" status: 200 len: 1502 microversion: 2.1 time: 0.228512 Jun 07 08:38:51.875535 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 64/115] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:51 2022] GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 => generated 1502 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:52.589938 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-a84f6d82-aa2e-4a86-af97-93a1d138d38d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:52.590557 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-a84f6d82-aa2e-4a86-af97-93a1d138d38d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:52.596751 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a84f6d82-aa2e-4a86-af97-93a1d138d38d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:52.597240 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a84f6d82-aa2e-4a86-af97-93a1d138d38d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:52.598008 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a84f6d82-aa2e-4a86-af97-93a1d138d38d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:52.598449 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a84f6d82-aa2e-4a86-af97-93a1d138d38d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:52.670695 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-f7abef4a-cde5-4bad-a027-9ea97c95951a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:52.671310 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-f7abef4a-cde5-4bad-a027-9ea97c95951a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:52.677665 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f7abef4a-cde5-4bad-a027-9ea97c95951a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:52.678048 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f7abef4a-cde5-4bad-a027-9ea97c95951a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:52.678824 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f7abef4a-cde5-4bad-a027-9ea97c95951a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:52.679265 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f7abef4a-cde5-4bad-a027-9ea97c95951a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:52.748750 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-a84f6d82-aa2e-4a86-af97-93a1d138d38d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:52.757286 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-a84f6d82-aa2e-4a86-af97-93a1d138d38d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:52.759066 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-a84f6d82-aa2e-4a86-af97-93a1d138d38d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:52.760167 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-a84f6d82-aa2e-4a86-af97-93a1d138d38d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1408 microversion: 2.20 time: 0.174170 Jun 07 08:38:52.761060 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 52/116] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:38:52 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:38:52.839917 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-f7abef4a-cde5-4bad-a027-9ea97c95951a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:52.851546 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-f7abef4a-cde5-4bad-a027-9ea97c95951a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1322 microversion: 2.1 time: 0.184461 Jun 07 08:38:52.853683 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 65/117] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:52 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:38:53.205290 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-0ecc82c6-2837-44ee-83a6-42f5f14168d9 req-c4534de9-e4b0-4613-9061-5e65aadd3d60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60630f0f-2831-479d-91fc-477b773635ad", "name": "network-vif-plugged", "status": "completed", "tag": "87bcbdda-ce88-44b8-b537-66a7d29ac04f"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:38:53.213458 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-0ecc82c6-2837-44ee-83a6-42f5f14168d9 req-c4534de9-e4b0-4613-9061-5e65aadd3d60 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:53.213908 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-0ecc82c6-2837-44ee-83a6-42f5f14168d9 req-c4534de9-e4b0-4613-9061-5e65aadd3d60 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:53.225064 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-0ecc82c6-2837-44ee-83a6-42f5f14168d9 req-c4534de9-e4b0-4613-9061-5e65aadd3d60 service nova] Creating event network-vif-plugged:87bcbdda-ce88-44b8-b537-66a7d29ac04f for instance 60630f0f-2831-479d-91fc-477b773635ad on hv-cinder-74014 Jun 07 08:38:53.230350 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-0ecc82c6-2837-44ee-83a6-42f5f14168d9 req-c4534de9-e4b0-4613-9061-5e65aadd3d60 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028888 Jun 07 08:38:53.230935 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 53/118] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:38:53.779264 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-4bf0c713-a1c3-4b1b-8009-30bc5108550b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:53.780687 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-4bf0c713-a1c3-4b1b-8009-30bc5108550b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:53.788403 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4bf0c713-a1c3-4b1b-8009-30bc5108550b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:53.788957 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4bf0c713-a1c3-4b1b-8009-30bc5108550b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:53.790015 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4bf0c713-a1c3-4b1b-8009-30bc5108550b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:53.790530 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4bf0c713-a1c3-4b1b-8009-30bc5108550b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:53.875338 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-b903e8b6-d956-48e6-bb96-04abac91ed22 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:53.889033 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-b903e8b6-d956-48e6-bb96-04abac91ed22 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:53.889033 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b903e8b6-d956-48e6-bb96-04abac91ed22 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:53.889033 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b903e8b6-d956-48e6-bb96-04abac91ed22 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:53.889033 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b903e8b6-d956-48e6-bb96-04abac91ed22 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:53.890139 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b903e8b6-d956-48e6-bb96-04abac91ed22 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:53.943334 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-4bf0c713-a1c3-4b1b-8009-30bc5108550b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:53.951914 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-4bf0c713-a1c3-4b1b-8009-30bc5108550b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:53.953606 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-4bf0c713-a1c3-4b1b-8009-30bc5108550b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:53.954710 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-4bf0c713-a1c3-4b1b-8009-30bc5108550b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1408 microversion: 2.20 time: 0.179879 Jun 07 08:38:53.955495 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 66/119] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:38:53 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1408 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:38:54.077610 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-b903e8b6-d956-48e6-bb96-04abac91ed22 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:54.086365 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-b903e8b6-d956-48e6-bb96-04abac91ed22 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1322 microversion: 2.1 time: 0.222238 Jun 07 08:38:54.086994 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 54/120] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:53 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:38:54.672646 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-e81a29be-b6dc-48b0-a366-adefa90560b6 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b756c4b-e9bc-4d79-a2d5-a71eb9e45668"}} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:38:54.672646 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-e81a29be-b6dc-48b0-a366-adefa90560b6 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:54.672646 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e81a29be-b6dc-48b0-a366-adefa90560b6 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:54.672646 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e81a29be-b6dc-48b0-a366-adefa90560b6 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:54.673257 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e81a29be-b6dc-48b0-a366-adefa90560b6 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:54.673257 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e81a29be-b6dc-48b0-a366-adefa90560b6 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:54.973970 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-39c0bf49-7069-4045-9466-8d3d069c4618 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:54.974617 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-39c0bf49-7069-4045-9466-8d3d069c4618 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:54.981836 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-39c0bf49-7069-4045-9466-8d3d069c4618 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:54.982318 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-39c0bf49-7069-4045-9466-8d3d069c4618 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:54.983099 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-39c0bf49-7069-4045-9466-8d3d069c4618 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:54.983534 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-39c0bf49-7069-4045-9466-8d3d069c4618 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:55.145429 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-39c0bf49-7069-4045-9466-8d3d069c4618 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:55.155814 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-39c0bf49-7069-4045-9466-8d3d069c4618 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:55.155814 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-39c0bf49-7069-4045-9466-8d3d069c4618 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:55.156416 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-39c0bf49-7069-4045-9466-8d3d069c4618 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1408 microversion: 2.20 time: 0.186195 Jun 07 08:38:55.156704 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 55/121] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:38:54 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:38:55.161427 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-7fd6d212-957d-4f3c-b5ab-81531a53d49e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:55.162045 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-7fd6d212-957d-4f3c-b5ab-81531a53d49e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:55.169274 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7fd6d212-957d-4f3c-b5ab-81531a53d49e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:55.169712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7fd6d212-957d-4f3c-b5ab-81531a53d49e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:55.170508 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7fd6d212-957d-4f3c-b5ab-81531a53d49e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:55.170953 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7fd6d212-957d-4f3c-b5ab-81531a53d49e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:55.316541 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-7fd6d212-957d-4f3c-b5ab-81531a53d49e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:55.326036 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-7fd6d212-957d-4f3c-b5ab-81531a53d49e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1515 microversion: 2.1 time: 0.168123 Jun 07 08:38:55.327936 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 56/122] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:55 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:55.348769 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-5fe8f4d9-ebd4-4d65-a617-6efbae0ab422 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:38:55.349737 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-5fe8f4d9-ebd4-4d65-a617-6efbae0ab422 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:55.358649 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5fe8f4d9-ebd4-4d65-a617-6efbae0ab422 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:55.359121 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5fe8f4d9-ebd4-4d65-a617-6efbae0ab422 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:55.360018 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5fe8f4d9-ebd4-4d65-a617-6efbae0ab422 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:55.360465 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5fe8f4d9-ebd4-4d65-a617-6efbae0ab422 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:55.441986 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.objects.instance [None req-5fe8f4d9-ebd4-4d65-a617-6efbae0ab422 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lazy-loading 'flavor' on Instance uuid b020097d-7d41-4338-a7a8-fe85f295435c {{(pid=129726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:38:55.829949 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:38:55.911700 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-5fe8f4d9-ebd4-4d65-a617-6efbae0ab422 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "POST /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c/action" status: 200 len: 32 microversion: 2.1 time: 0.566760 Jun 07 08:38:55.912432 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 57/123] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jun 7 08:38:55 2022] POST /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c/action => generated 32 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 08:38:55.923917 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-4f48e546-a30b-4dea-882d-bd8cacbd3b00 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:55.924741 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-4f48e546-a30b-4dea-882d-bd8cacbd3b00 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:55.931797 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4f48e546-a30b-4dea-882d-bd8cacbd3b00 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:55.932473 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4f48e546-a30b-4dea-882d-bd8cacbd3b00 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:55.933496 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4f48e546-a30b-4dea-882d-bd8cacbd3b00 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:55.934187 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4f48e546-a30b-4dea-882d-bd8cacbd3b00 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:56.234286 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-4f48e546-a30b-4dea-882d-bd8cacbd3b00 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:56.246617 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-4f48e546-a30b-4dea-882d-bd8cacbd3b00 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1521 microversion: 2.1 time: 0.327862 Jun 07 08:38:56.247203 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 58/124] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:55 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:56.264243 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-b2668e9a-acc9-474c-a91a-cc33b9c691c3 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:56.264900 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-b2668e9a-acc9-474c-a91a-cc33b9c691c3 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:56.282850 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b2668e9a-acc9-474c-a91a-cc33b9c691c3 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:56.283303 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b2668e9a-acc9-474c-a91a-cc33b9c691c3 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:56.284351 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b2668e9a-acc9-474c-a91a-cc33b9c691c3 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:56.284794 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b2668e9a-acc9-474c-a91a-cc33b9c691c3 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:56.695204 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-b2668e9a-acc9-474c-a91a-cc33b9c691c3 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:56.703728 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-b2668e9a-acc9-474c-a91a-cc33b9c691c3 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:56.705904 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-b2668e9a-acc9-474c-a91a-cc33b9c691c3 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:56.707173 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-b2668e9a-acc9-474c-a91a-cc33b9c691c3 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1599 microversion: 2.20 time: 0.450347 Jun 07 08:38:56.721217 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 59/125] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:38:56 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1599 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:38:56.730246 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-6f4ae5f0-3d11-458c-aa27-4be8e9daaec5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:56.730753 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-6f4ae5f0-3d11-458c-aa27-4be8e9daaec5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:56.737154 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6f4ae5f0-3d11-458c-aa27-4be8e9daaec5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:56.737609 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6f4ae5f0-3d11-458c-aa27-4be8e9daaec5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:56.738577 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6f4ae5f0-3d11-458c-aa27-4be8e9daaec5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:56.739016 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6f4ae5f0-3d11-458c-aa27-4be8e9daaec5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:56.785335 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-e81a29be-b6dc-48b0-a366-adefa90560b6 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "POST /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.134148 Jun 07 08:38:56.791994 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 67/126] 10.222.0.17 () {60 vars in 1322 bytes} [Tue Jun 7 08:38:54 2022] POST /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77/os-volume_attachments => generated 194 bytes in 2136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:38:56.885852 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-6f4ae5f0-3d11-458c-aa27-4be8e9daaec5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.159592 Jun 07 08:38:56.889533 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 60/127] 10.222.0.17 () {60 vars in 1315 bytes} [Tue Jun 7 08:38:56 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad/os-interface => generated 284 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 08:38:57.269242 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-c29802e7-e914-4ff1-85b8-07737c83121a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:57.270004 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-c29802e7-e914-4ff1-85b8-07737c83121a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:57.283302 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c29802e7-e914-4ff1-85b8-07737c83121a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:57.283775 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c29802e7-e914-4ff1-85b8-07737c83121a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:57.284842 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c29802e7-e914-4ff1-85b8-07737c83121a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:57.285312 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c29802e7-e914-4ff1-85b8-07737c83121a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:57.295723 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:38:58.086123 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-c29802e7-e914-4ff1-85b8-07737c83121a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:58.094223 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-c29802e7-e914-4ff1-85b8-07737c83121a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1521 microversion: 2.1 time: 0.829916 Jun 07 08:38:58.095099 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 68/128] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:57 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1521 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:38:58.785848 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-b3325495-cee5-419b-9a8f-cc20b8ec273a req-768ed349-fd84-476c-9e15-f67c0ea32397 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60630f0f-2831-479d-91fc-477b773635ad", "tag": "87bcbdda-ce88-44b8-b537-66a7d29ac04f"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:38:58.785848 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-b3325495-cee5-419b-9a8f-cc20b8ec273a req-768ed349-fd84-476c-9e15-f67c0ea32397 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:58.785848 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-b3325495-cee5-419b-9a8f-cc20b8ec273a req-768ed349-fd84-476c-9e15-f67c0ea32397 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:58.785848 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-b3325495-cee5-419b-9a8f-cc20b8ec273a req-768ed349-fd84-476c-9e15-f67c0ea32397 service nova] Creating event network-changed:87bcbdda-ce88-44b8-b537-66a7d29ac04f for instance 60630f0f-2831-479d-91fc-477b773635ad on hv-cinder-74014 Jun 07 08:38:58.796742 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-b3325495-cee5-419b-9a8f-cc20b8ec273a req-768ed349-fd84-476c-9e15-f67c0ea32397 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057662 Jun 07 08:38:58.796742 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 61/129] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:38:59.113534 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-0ca8cd02-b8b4-4477-b8eb-cd0d73795641 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:38:59.113534 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-0ca8cd02-b8b4-4477-b8eb-cd0d73795641 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:38:59.142933 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0ca8cd02-b8b4-4477-b8eb-cd0d73795641 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:59.144644 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0ca8cd02-b8b4-4477-b8eb-cd0d73795641 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:59.145674 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0ca8cd02-b8b4-4477-b8eb-cd0d73795641 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:38:59.148293 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0ca8cd02-b8b4-4477-b8eb-cd0d73795641 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:38:59.348843 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-0ca8cd02-b8b4-4477-b8eb-cd0d73795641 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:38:59.368171 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-0ca8cd02-b8b4-4477-b8eb-cd0d73795641 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1521 microversion: 2.1 time: 0.260221 Jun 07 08:38:59.373054 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 69/130] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:38:59 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:00.390726 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-ed1c911e-45c7-46d6-874f-715b2e10271c tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:00.393637 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-ed1c911e-45c7-46d6-874f-715b2e10271c tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:00.406704 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ed1c911e-45c7-46d6-874f-715b2e10271c tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:00.407159 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ed1c911e-45c7-46d6-874f-715b2e10271c tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:00.407940 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ed1c911e-45c7-46d6-874f-715b2e10271c tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:00.408379 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ed1c911e-45c7-46d6-874f-715b2e10271c tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:00.565730 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-ed1c911e-45c7-46d6-874f-715b2e10271c tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:00.574437 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-ed1c911e-45c7-46d6-874f-715b2e10271c tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1521 microversion: 2.1 time: 0.188263 Jun 07 08:39:00.575008 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 62/131] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:00 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:01.594223 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-db732f92-f11d-40dd-821b-92ec977def88 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:01.595745 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-db732f92-f11d-40dd-821b-92ec977def88 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:01.606037 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-db732f92-f11d-40dd-821b-92ec977def88 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:01.606037 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-db732f92-f11d-40dd-821b-92ec977def88 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:01.606037 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-db732f92-f11d-40dd-821b-92ec977def88 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:01.608038 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-db732f92-f11d-40dd-821b-92ec977def88 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:01.819402 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-db732f92-f11d-40dd-821b-92ec977def88 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:01.827670 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-db732f92-f11d-40dd-821b-92ec977def88 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1521 microversion: 2.1 time: 0.238069 Jun 07 08:39:01.828910 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 70/132] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:01 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:02.849303 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-2f8f2829-47e3-4404-8a1b-19d4e2defdc8 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:02.850603 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-2f8f2829-47e3-4404-8a1b-19d4e2defdc8 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:02.857161 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2f8f2829-47e3-4404-8a1b-19d4e2defdc8 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:02.857955 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2f8f2829-47e3-4404-8a1b-19d4e2defdc8 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:02.858745 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2f8f2829-47e3-4404-8a1b-19d4e2defdc8 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:02.859180 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2f8f2829-47e3-4404-8a1b-19d4e2defdc8 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:03.021238 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-2f8f2829-47e3-4404-8a1b-19d4e2defdc8 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:03.029635 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-2f8f2829-47e3-4404-8a1b-19d4e2defdc8 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1521 microversion: 2.1 time: 0.186856 Jun 07 08:39:03.030270 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 63/133] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:02 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:04.050184 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-d59fed5b-fe7d-45fa-a529-2e3f2487b04a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:04.050810 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-d59fed5b-fe7d-45fa-a529-2e3f2487b04a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:04.059623 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d59fed5b-fe7d-45fa-a529-2e3f2487b04a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:04.059623 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d59fed5b-fe7d-45fa-a529-2e3f2487b04a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:04.060608 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d59fed5b-fe7d-45fa-a529-2e3f2487b04a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:04.061123 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d59fed5b-fe7d-45fa-a529-2e3f2487b04a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:04.218087 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-d59fed5b-fe7d-45fa-a529-2e3f2487b04a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:04.230963 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-d59fed5b-fe7d-45fa-a529-2e3f2487b04a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1521 microversion: 2.1 time: 0.183356 Jun 07 08:39:04.230963 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 71/134] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:04 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:05.248500 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-814532fe-9aeb-4dfb-8223-7d796848403a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:05.249136 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-814532fe-9aeb-4dfb-8223-7d796848403a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:05.256758 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-814532fe-9aeb-4dfb-8223-7d796848403a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:05.257328 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-814532fe-9aeb-4dfb-8223-7d796848403a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:05.258707 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-814532fe-9aeb-4dfb-8223-7d796848403a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:05.259693 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-814532fe-9aeb-4dfb-8223-7d796848403a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:05.430146 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-814532fe-9aeb-4dfb-8223-7d796848403a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:05.442635 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-814532fe-9aeb-4dfb-8223-7d796848403a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1521 microversion: 2.1 time: 0.194925 Jun 07 08:39:05.442635 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 64/135] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:05 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:06.458195 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-fcd8d01b-31ab-41ce-a994-645e073f5c29 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:06.458817 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-fcd8d01b-31ab-41ce-a994-645e073f5c29 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:06.466663 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-fcd8d01b-31ab-41ce-a994-645e073f5c29 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:06.467120 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-fcd8d01b-31ab-41ce-a994-645e073f5c29 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:06.467911 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-fcd8d01b-31ab-41ce-a994-645e073f5c29 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:06.468345 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-fcd8d01b-31ab-41ce-a994-645e073f5c29 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:06.635318 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-fcd8d01b-31ab-41ce-a994-645e073f5c29 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:06.664950 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-fcd8d01b-31ab-41ce-a994-645e073f5c29 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1521 microversion: 2.1 time: 0.210386 Jun 07 08:39:06.665950 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 72/136] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:06 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:07.436676 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-5c71ac42-9ea6-4dd8-b5a3-3ed1bbc40c9a tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:07.440672 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-5c71ac42-9ea6-4dd8-b5a3-3ed1bbc40c9a tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:07.447864 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5c71ac42-9ea6-4dd8-b5a3-3ed1bbc40c9a tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:07.448356 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5c71ac42-9ea6-4dd8-b5a3-3ed1bbc40c9a tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:07.449165 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5c71ac42-9ea6-4dd8-b5a3-3ed1bbc40c9a tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:07.449606 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5c71ac42-9ea6-4dd8-b5a3-3ed1bbc40c9a tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:07.488726 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-5c71ac42-9ea6-4dd8-b5a3-3ed1bbc40c9a tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Going to try to terminate instance {{(pid=129726) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 08:39:07.689620 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-266ed234-87dc-47a2-9036-f33520dbd794 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:07.690076 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-266ed234-87dc-47a2-9036-f33520dbd794 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:07.700041 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-266ed234-87dc-47a2-9036-f33520dbd794 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:07.706938 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-266ed234-87dc-47a2-9036-f33520dbd794 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:07.709674 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-266ed234-87dc-47a2-9036-f33520dbd794 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:07.712079 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-266ed234-87dc-47a2-9036-f33520dbd794 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:07.787395 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-5c71ac42-9ea6-4dd8-b5a3-3ed1bbc40c9a tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77" status: 204 len: 0 microversion: 2.1 time: 0.354731 Jun 07 08:39:07.788144 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 65/137] 10.222.0.17 () {58 vars in 1238 bytes} [Tue Jun 7 08:39:07 2022] DELETE /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 08:39:07.804103 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-8f472a50-9e2b-4934-a144-8e71d695e79f tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:07.804879 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-8f472a50-9e2b-4934-a144-8e71d695e79f tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:07.812088 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8f472a50-9e2b-4934-a144-8e71d695e79f tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:07.812593 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8f472a50-9e2b-4934-a144-8e71d695e79f tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:07.813579 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8f472a50-9e2b-4934-a144-8e71d695e79f tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:07.814148 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8f472a50-9e2b-4934-a144-8e71d695e79f tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:07.911091 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-266ed234-87dc-47a2-9036-f33520dbd794 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:07.921307 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-266ed234-87dc-47a2-9036-f33520dbd794 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1521 microversion: 2.1 time: 0.241320 Jun 07 08:39:07.924737 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 73/138] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:07 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:39:08.067904 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-8f472a50-9e2b-4934-a144-8e71d695e79f tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae58168dadc845daa0958cf975a41abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ee9298ae04230979b6a62d24be0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:08.080970 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-8f472a50-9e2b-4934-a144-8e71d695e79f tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77" status: 200 len: 1554 microversion: 2.1 time: 0.282030 Jun 07 08:39:08.081995 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 66/139] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:07 2022] GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 => generated 1554 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:39:08.948914 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-8c185661-8c70-4ec7-b22c-b49fc5e6690e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:08.950259 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-8c185661-8c70-4ec7-b22c-b49fc5e6690e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:08.964927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8c185661-8c70-4ec7-b22c-b49fc5e6690e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:08.965476 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8c185661-8c70-4ec7-b22c-b49fc5e6690e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:08.967936 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8c185661-8c70-4ec7-b22c-b49fc5e6690e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:08.968352 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8c185661-8c70-4ec7-b22c-b49fc5e6690e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:09.102727 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-79be8c37-9885-496c-a1f5-689f0a58b29a tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:09.103747 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-79be8c37-9885-496c-a1f5-689f0a58b29a tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:09.113228 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:39:09.115904 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-79be8c37-9885-496c-a1f5-689f0a58b29a tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:09.116351 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-79be8c37-9885-496c-a1f5-689f0a58b29a tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:09.117329 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-79be8c37-9885-496c-a1f5-689f0a58b29a tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:09.117769 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-79be8c37-9885-496c-a1f5-689f0a58b29a tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:09.211299 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-8c185661-8c70-4ec7-b22c-b49fc5e6690e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:09.219392 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-8c185661-8c70-4ec7-b22c-b49fc5e6690e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1521 microversion: 2.1 time: 0.274936 Jun 07 08:39:09.220225 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 74/140] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:08 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:09.282036 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-79be8c37-9885-496c-a1f5-689f0a58b29a tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae58168dadc845daa0958cf975a41abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ee9298ae04230979b6a62d24be0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:09.297673 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-79be8c37-9885-496c-a1f5-689f0a58b29a tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77" status: 200 len: 1554 microversion: 2.1 time: 0.199694 Jun 07 08:39:09.299184 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 67/141] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:09 2022] GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 => generated 1554 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:10.239788 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-f6c05981-6e23-4908-975e-630cf591a315 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:10.241916 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-f6c05981-6e23-4908-975e-630cf591a315 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:10.252743 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f6c05981-6e23-4908-975e-630cf591a315 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:10.253164 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f6c05981-6e23-4908-975e-630cf591a315 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:10.257464 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f6c05981-6e23-4908-975e-630cf591a315 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:10.257916 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f6c05981-6e23-4908-975e-630cf591a315 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:10.322981 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-088b46cd-ab8c-4f11-964e-1db8a6ca6efa tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:10.324229 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-088b46cd-ab8c-4f11-964e-1db8a6ca6efa tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:10.333673 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-088b46cd-ab8c-4f11-964e-1db8a6ca6efa tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:10.338422 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-088b46cd-ab8c-4f11-964e-1db8a6ca6efa tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:10.338422 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-088b46cd-ab8c-4f11-964e-1db8a6ca6efa tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:10.338422 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-088b46cd-ab8c-4f11-964e-1db8a6ca6efa tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:10.484819 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-f6c05981-6e23-4908-975e-630cf591a315 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:10.512669 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-f6c05981-6e23-4908-975e-630cf591a315 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1521 microversion: 2.1 time: 0.277026 Jun 07 08:39:10.515010 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 75/142] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:10 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:10.597145 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-088b46cd-ab8c-4f11-964e-1db8a6ca6efa tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae58168dadc845daa0958cf975a41abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ee9298ae04230979b6a62d24be0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:10.607836 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-088b46cd-ab8c-4f11-964e-1db8a6ca6efa tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77" status: 200 len: 1554 microversion: 2.1 time: 0.289500 Jun 07 08:39:10.618930 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 68/143] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:10 2022] GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 => generated 1554 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:10.833793 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-f0438a60-5ead-4542-bea8-5023fdd98cb1 req-b6f7168f-7348-463e-862b-94dbe1622793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e0e129e-3c0a-4372-a1e8-c508a3d27e77", "name": "network-vif-deleted", "tag": "9603dafb-8d69-420d-920a-0f9c65f83393"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:39:10.845047 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-f0438a60-5ead-4542-bea8-5023fdd98cb1 req-b6f7168f-7348-463e-862b-94dbe1622793 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:10.845790 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-f0438a60-5ead-4542-bea8-5023fdd98cb1 req-b6f7168f-7348-463e-862b-94dbe1622793 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:10.861270 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-f0438a60-5ead-4542-bea8-5023fdd98cb1 req-b6f7168f-7348-463e-862b-94dbe1622793 service nova] Creating event network-vif-deleted:9603dafb-8d69-420d-920a-0f9c65f83393 for instance 6e0e129e-3c0a-4372-a1e8-c508a3d27e77 on hv-cinder-74014 Jun 07 08:39:10.867946 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-f0438a60-5ead-4542-bea8-5023fdd98cb1 req-b6f7168f-7348-463e-862b-94dbe1622793 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037631 Jun 07 08:39:10.868701 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 76/144] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:39:11.534974 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-242d5bfb-9f1a-4652-8a4a-a571f5514ec5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:11.536445 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-242d5bfb-9f1a-4652-8a4a-a571f5514ec5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:11.550943 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-242d5bfb-9f1a-4652-8a4a-a571f5514ec5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:11.551834 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-242d5bfb-9f1a-4652-8a4a-a571f5514ec5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:11.553625 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-242d5bfb-9f1a-4652-8a4a-a571f5514ec5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:11.554672 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-242d5bfb-9f1a-4652-8a4a-a571f5514ec5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:11.645259 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-b671a840-0cfd-4152-b48f-61aeaf7f0926 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:11.647144 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-b671a840-0cfd-4152-b48f-61aeaf7f0926 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:11.668516 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b671a840-0cfd-4152-b48f-61aeaf7f0926 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:11.668516 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b671a840-0cfd-4152-b48f-61aeaf7f0926 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:11.668516 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b671a840-0cfd-4152-b48f-61aeaf7f0926 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:11.668516 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b671a840-0cfd-4152-b48f-61aeaf7f0926 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:11.722015 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b671a840-0cfd-4152-b48f-61aeaf7f0926 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:11.722746 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b671a840-0cfd-4152-b48f-61aeaf7f0926 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:11.723497 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.objects.instance [None req-b671a840-0cfd-4152-b48f-61aeaf7f0926 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lazy-loading 'fault' on Instance uuid 6e0e129e-3c0a-4372-a1e8-c508a3d27e77 {{(pid=129725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:39:11.792125 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-242d5bfb-9f1a-4652-8a4a-a571f5514ec5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:11.800330 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-242d5bfb-9f1a-4652-8a4a-a571f5514ec5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1521 microversion: 2.1 time: 0.271902 Jun 07 08:39:11.801618 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 69/145] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:11 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:11.807148 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-b671a840-0cfd-4152-b48f-61aeaf7f0926 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae58168dadc845daa0958cf975a41abd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26ee9298ae04230979b6a62d24be0e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:11.817550 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-b671a840-0cfd-4152-b48f-61aeaf7f0926 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77" status: 200 len: 1351 microversion: 2.1 time: 0.191365 Jun 07 08:39:11.819578 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 77/146] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:11 2022] GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 => generated 1351 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:39:12.817889 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-47fff82b-e68b-4675-80af-baf59f3e8079 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:12.819259 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-47fff82b-e68b-4675-80af-baf59f3e8079 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:12.828549 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-47fff82b-e68b-4675-80af-baf59f3e8079 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:12.829015 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-47fff82b-e68b-4675-80af-baf59f3e8079 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:12.829791 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-47fff82b-e68b-4675-80af-baf59f3e8079 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:12.830221 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-47fff82b-e68b-4675-80af-baf59f3e8079 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:12.861156 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-532fb08e-80d7-4521-891c-f84060c1f32c tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:12.862495 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-532fb08e-80d7-4521-891c-f84060c1f32c tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:12.870636 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-532fb08e-80d7-4521-891c-f84060c1f32c tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:12.871484 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-532fb08e-80d7-4521-891c-f84060c1f32c tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:12.872488 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-532fb08e-80d7-4521-891c-f84060c1f32c tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:12.873173 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-532fb08e-80d7-4521-891c-f84060c1f32c tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:12.889925 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.wsgi [None req-532fb08e-80d7-4521-891c-f84060c1f32c tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] HTTP exception thrown: Instance 6e0e129e-3c0a-4372-a1e8-c508a3d27e77 could not be found. Jun 07 08:39:12.895054 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-532fb08e-80d7-4521-891c-f84060c1f32c tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Request method failure captured: Jun 07 08:39:12.895054 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: request: GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 HTTP/1.1 Jun 07 08:39:12.895054 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept: application/json Jun 07 08:39:12.895054 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept-Encoding: identity Jun 07 08:39:12.895054 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Connection: close Jun 07 08:39:12.895054 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Length: 0 Jun 07 08:39:12.895054 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Type: application/json Jun 07 08:39:12.895054 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Host: 10.222.0.17 Jun 07 08:39:12.895054 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Openstack-System-Scope: None Jun 07 08:39:12.895054 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: User-Agent: python-urllib3/1.26.9 Jun 07 08:39:12.895054 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Auth-Token: gAAAAABinw5yiwg4S8CbgYcBFZzaDG-BfOURbEsGmaxlnXzfygysrEVLMAFvlUknZQ_0IquiS1sg4MD3mrIR7qxeue0B3yLy44DqXnVF92SqKOdHK5km35XGTpWN-Hv6kVL-BUukm7HQdRUNCK7LQyle12ywLg_NoPQFFEfLM4HWHJXrN33vCAQ Jun 07 08:39:12.895054 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Id: None Jun 07 08:39:12.895054 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Name: None Jun 07 08:39:12.895054 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Identity-Status: Confirmed Jun 07 08:39:12.895054 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Is-Admin-Project: True Jun 07 08:39:12.895054 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Id: default Jun 07 08:39:12.895054 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Name: Default Jun 07 08:39:12.895054 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Id: f26ee9298ae04230979b6a62d24be0e1 Jun 07 08:39:12.895054 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Name: tempest-DeleteServersTestJSON-1794422058 Jun 07 08:39:12.895054 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Role: reader,member Jun 07 08:39:12.895054 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Roles: reader,member Jun 07 08:39:12.901349 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f26ee9298ae04230979b6a62d24be0e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f26ee9298ae04230979b6a62d24be0e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f26ee9298ae04230979b6a62d24be0e1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f26ee9298ae04230979b6a62d24be0e1"}]}] Jun 07 08:39:12.901349 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant: tempest-DeleteServersTestJSON-1794422058 Jun 07 08:39:12.901349 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Id: f26ee9298ae04230979b6a62d24be0e1 Jun 07 08:39:12.901349 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Name: tempest-DeleteServersTestJSON-1794422058 Jun 07 08:39:12.901349 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User: tempest-DeleteServersTestJSON-1794422058-project Jun 07 08:39:12.901349 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Id: default Jun 07 08:39:12.901349 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Name: Default Jun 07 08:39:12.901349 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Id: ae58168dadc845daa0958cf975a41abd Jun 07 08:39:12.901349 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Name: tempest-DeleteServersTestJSON-1794422058-project Jun 07 08:39:12.901349 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: method: > Jun 07 08:39:12.901349 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: exception: Instance 6e0e129e-3c0a-4372-a1e8-c508a3d27e77 could not be found. Jun 07 08:39:12.901349 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: action_args: {'id': '6e0e129e-3c0a-4372-a1e8-c508a3d27e77'} Jun 07 08:39:12.903073 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:39:12.903073 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:39:12.903073 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:39:12.903073 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:39:12.903073 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:39:12.903073 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:39:12.903073 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:39:12.903073 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:39:12.903073 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:39:12.903073 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:39:12.903073 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e0e129e-3c0a-4372-a1e8-c508a3d27e77 could not be found. Jun 07 08:39:12.903073 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:39:12.903073 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:39:12.903073 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:39:12.903073 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:39:12.903073 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:39:12.903073 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:39:12.903073 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:39:12.903073 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:39:12.903073 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:39:12.905327 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:39:12.905327 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 08:39:12.905327 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 08:39:12.905327 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:39:12.905327 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:39:12.905327 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:39:12.905327 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:39:12.905327 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e0e129e-3c0a-4372-a1e8-c508a3d27e77 could not be found. Jun 07 08:39:12.905327 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:39:12.905327 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:39:12.905327 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:39:12.905327 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:39:12.905327 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:39:12.905327 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:39:12.905327 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:39:12.905327 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:39:12.905327 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e0e129e-3c0a-4372-a1e8-c508a3d27e77 could not be found. Jun 07 08:39:12.905327 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:39:12.907657 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-532fb08e-80d7-4521-891c-f84060c1f32c tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Returning 404 to user: Instance 6e0e129e-3c0a-4372-a1e8-c508a3d27e77 could not be found. {{(pid=129725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:39:12.907657 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-532fb08e-80d7-4521-891c-f84060c1f32c tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77" status: 404 len: 111 microversion: 2.1 time: 0.039883 Jun 07 08:39:12.907657 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 78/147] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:12 2022] GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:39:13.067940 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-47fff82b-e68b-4675-80af-baf59f3e8079 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:13.071695 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-8b662a95-0db5-4a80-b1ba-6b6f0bb9c7d9 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:13.073092 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-8b662a95-0db5-4a80-b1ba-6b6f0bb9c7d9 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:13.088755 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-47fff82b-e68b-4675-80af-baf59f3e8079 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1521 microversion: 2.1 time: 0.274056 Jun 07 08:39:13.092821 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 70/148] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:12 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:13.093436 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8b662a95-0db5-4a80-b1ba-6b6f0bb9c7d9 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:13.094268 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8b662a95-0db5-4a80-b1ba-6b6f0bb9c7d9 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:13.095400 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8b662a95-0db5-4a80-b1ba-6b6f0bb9c7d9 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:13.095849 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8b662a95-0db5-4a80-b1ba-6b6f0bb9c7d9 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:13.122731 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.wsgi [None req-8b662a95-0db5-4a80-b1ba-6b6f0bb9c7d9 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] HTTP exception thrown: Instance 6e0e129e-3c0a-4372-a1e8-c508a3d27e77 could not be found. Jun 07 08:39:13.122981 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-8b662a95-0db5-4a80-b1ba-6b6f0bb9c7d9 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Request method failure captured: Jun 07 08:39:13.122981 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: request: GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77/os-volume_attachments HTTP/1.1 Jun 07 08:39:13.122981 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept: application/json Jun 07 08:39:13.122981 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept-Encoding: identity Jun 07 08:39:13.122981 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Connection: close Jun 07 08:39:13.122981 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Length: 0 Jun 07 08:39:13.122981 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Type: application/json Jun 07 08:39:13.122981 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Host: 10.222.0.17 Jun 07 08:39:13.122981 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Openstack-System-Scope: None Jun 07 08:39:13.122981 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: User-Agent: python-urllib3/1.26.9 Jun 07 08:39:13.122981 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Auth-Token: gAAAAABinw5yiwg4S8CbgYcBFZzaDG-BfOURbEsGmaxlnXzfygysrEVLMAFvlUknZQ_0IquiS1sg4MD3mrIR7qxeue0B3yLy44DqXnVF92SqKOdHK5km35XGTpWN-Hv6kVL-BUukm7HQdRUNCK7LQyle12ywLg_NoPQFFEfLM4HWHJXrN33vCAQ Jun 07 08:39:13.122981 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Id: None Jun 07 08:39:13.122981 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Name: None Jun 07 08:39:13.122981 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Identity-Status: Confirmed Jun 07 08:39:13.122981 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Is-Admin-Project: True Jun 07 08:39:13.122981 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Id: default Jun 07 08:39:13.122981 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Name: Default Jun 07 08:39:13.122981 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Id: f26ee9298ae04230979b6a62d24be0e1 Jun 07 08:39:13.122981 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Name: tempest-DeleteServersTestJSON-1794422058 Jun 07 08:39:13.122981 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Role: reader,member Jun 07 08:39:13.122981 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Roles: reader,member Jun 07 08:39:13.124864 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f26ee9298ae04230979b6a62d24be0e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f26ee9298ae04230979b6a62d24be0e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f26ee9298ae04230979b6a62d24be0e1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f26ee9298ae04230979b6a62d24be0e1"}]}] Jun 07 08:39:13.124864 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant: tempest-DeleteServersTestJSON-1794422058 Jun 07 08:39:13.124864 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Id: f26ee9298ae04230979b6a62d24be0e1 Jun 07 08:39:13.124864 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Name: tempest-DeleteServersTestJSON-1794422058 Jun 07 08:39:13.124864 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User: tempest-DeleteServersTestJSON-1794422058-project Jun 07 08:39:13.124864 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Id: default Jun 07 08:39:13.124864 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Name: Default Jun 07 08:39:13.124864 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Id: ae58168dadc845daa0958cf975a41abd Jun 07 08:39:13.124864 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Name: tempest-DeleteServersTestJSON-1794422058-project Jun 07 08:39:13.124864 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: method: > Jun 07 08:39:13.124864 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: exception: Instance 6e0e129e-3c0a-4372-a1e8-c508a3d27e77 could not be found. Jun 07 08:39:13.124864 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: action_args: {'server_id': '6e0e129e-3c0a-4372-a1e8-c508a3d27e77'} Jun 07 08:39:13.125716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:39:13.125716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:39:13.125716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:39:13.125716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:39:13.125716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:39:13.125716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:39:13.125716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:39:13.125716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:39:13.125716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:39:13.125716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:39:13.125716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e0e129e-3c0a-4372-a1e8-c508a3d27e77 could not be found. Jun 07 08:39:13.125716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:39:13.125716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:39:13.125716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:39:13.125716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:39:13.125716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:39:13.125716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:39:13.125716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:39:13.125716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:39:13.125716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:39:13.126751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:39:13.126751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 07 08:39:13.126751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 08:39:13.126751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 07 08:39:13.126751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 08:39:13.126751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 07 08:39:13.126751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 07 08:39:13.126751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:39:13.126751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:39:13.126751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e0e129e-3c0a-4372-a1e8-c508a3d27e77 could not be found. Jun 07 08:39:13.126751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:39:13.126751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:39:13.126751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:39:13.126751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:39:13.126751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:39:13.126751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:39:13.126751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:39:13.126751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:39:13.126751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e0e129e-3c0a-4372-a1e8-c508a3d27e77 could not be found. Jun 07 08:39:13.126751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:39:13.127795 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-8b662a95-0db5-4a80-b1ba-6b6f0bb9c7d9 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Returning 404 to user: Instance 6e0e129e-3c0a-4372-a1e8-c508a3d27e77 could not be found. {{(pid=129725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:39:13.127795 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-8b662a95-0db5-4a80-b1ba-6b6f0bb9c7d9 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.073197 Jun 07 08:39:13.127795 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 79/149] 10.222.0.17 () {58 vars in 1301 bytes} [Tue Jun 7 08:39:13 2022] GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77/os-volume_attachments => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 08:39:14.109308 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-1f16aea0-e3d0-4df0-93f9-264ce61a8b50 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:14.111247 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-1f16aea0-e3d0-4df0-93f9-264ce61a8b50 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:14.116422 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1f16aea0-e3d0-4df0-93f9-264ce61a8b50 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:14.116874 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1f16aea0-e3d0-4df0-93f9-264ce61a8b50 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:14.117686 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1f16aea0-e3d0-4df0-93f9-264ce61a8b50 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:14.121801 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1f16aea0-e3d0-4df0-93f9-264ce61a8b50 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:14.257697 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-1f16aea0-e3d0-4df0-93f9-264ce61a8b50 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:14.266170 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-1f16aea0-e3d0-4df0-93f9-264ce61a8b50 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1521 microversion: 2.1 time: 0.160871 Jun 07 08:39:14.266170 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 71/150] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:14 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:14.585674 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-8bb05880-2cb4-448c-a88d-6988505cd823 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:14.586178 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-8bb05880-2cb4-448c-a88d-6988505cd823 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:14.593317 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8bb05880-2cb4-448c-a88d-6988505cd823 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:14.594028 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8bb05880-2cb4-448c-a88d-6988505cd823 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:14.594813 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8bb05880-2cb4-448c-a88d-6988505cd823 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:14.595245 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8bb05880-2cb4-448c-a88d-6988505cd823 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:14.613316 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.wsgi [None req-8bb05880-2cb4-448c-a88d-6988505cd823 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] HTTP exception thrown: Instance 6e0e129e-3c0a-4372-a1e8-c508a3d27e77 could not be found. Jun 07 08:39:14.615666 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-8bb05880-2cb4-448c-a88d-6988505cd823 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Request method failure captured: Jun 07 08:39:14.615666 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: request: DELETE /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 HTTP/1.1 Jun 07 08:39:14.615666 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept: application/json Jun 07 08:39:14.615666 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept-Encoding: identity Jun 07 08:39:14.615666 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Connection: close Jun 07 08:39:14.615666 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Length: 0 Jun 07 08:39:14.615666 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Type: application/json Jun 07 08:39:14.615666 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Host: 10.222.0.17 Jun 07 08:39:14.615666 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Openstack-System-Scope: None Jun 07 08:39:14.615666 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: User-Agent: python-urllib3/1.26.9 Jun 07 08:39:14.615666 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Auth-Token: gAAAAABinw5yiwg4S8CbgYcBFZzaDG-BfOURbEsGmaxlnXzfygysrEVLMAFvlUknZQ_0IquiS1sg4MD3mrIR7qxeue0B3yLy44DqXnVF92SqKOdHK5km35XGTpWN-Hv6kVL-BUukm7HQdRUNCK7LQyle12ywLg_NoPQFFEfLM4HWHJXrN33vCAQ Jun 07 08:39:14.615666 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Id: None Jun 07 08:39:14.615666 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Name: None Jun 07 08:39:14.615666 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Identity-Status: Confirmed Jun 07 08:39:14.615666 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Is-Admin-Project: True Jun 07 08:39:14.615666 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Id: default Jun 07 08:39:14.615666 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Name: Default Jun 07 08:39:14.615666 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Id: f26ee9298ae04230979b6a62d24be0e1 Jun 07 08:39:14.615666 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Name: tempest-DeleteServersTestJSON-1794422058 Jun 07 08:39:14.615666 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Role: reader,member Jun 07 08:39:14.615666 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Roles: reader,member Jun 07 08:39:14.617265 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f26ee9298ae04230979b6a62d24be0e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f26ee9298ae04230979b6a62d24be0e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f26ee9298ae04230979b6a62d24be0e1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f26ee9298ae04230979b6a62d24be0e1"}]}] Jun 07 08:39:14.617265 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant: tempest-DeleteServersTestJSON-1794422058 Jun 07 08:39:14.617265 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Id: f26ee9298ae04230979b6a62d24be0e1 Jun 07 08:39:14.617265 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Name: tempest-DeleteServersTestJSON-1794422058 Jun 07 08:39:14.617265 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User: tempest-DeleteServersTestJSON-1794422058-project Jun 07 08:39:14.617265 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Id: default Jun 07 08:39:14.617265 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Name: Default Jun 07 08:39:14.617265 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Id: ae58168dadc845daa0958cf975a41abd Jun 07 08:39:14.617265 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Name: tempest-DeleteServersTestJSON-1794422058-project Jun 07 08:39:14.617265 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: method: > Jun 07 08:39:14.617265 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: exception: Instance 6e0e129e-3c0a-4372-a1e8-c508a3d27e77 could not be found. Jun 07 08:39:14.617265 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: action_args: {'id': '6e0e129e-3c0a-4372-a1e8-c508a3d27e77'} Jun 07 08:39:14.618303 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:39:14.618303 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:39:14.618303 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:39:14.618303 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:39:14.618303 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:39:14.618303 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:39:14.618303 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:39:14.618303 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:39:14.618303 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:39:14.618303 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:39:14.618303 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e0e129e-3c0a-4372-a1e8-c508a3d27e77 could not be found. Jun 07 08:39:14.618303 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:39:14.618303 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:39:14.618303 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:39:14.618303 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:39:14.618303 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:39:14.618303 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:39:14.618303 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:39:14.618303 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:39:14.618303 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:39:14.619595 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:39:14.619595 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 08:39:14.619595 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 08:39:14.619595 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 08:39:14.619595 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 08:39:14.619595 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:39:14.619595 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:39:14.619595 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:39:14.619595 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:39:14.619595 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e0e129e-3c0a-4372-a1e8-c508a3d27e77 could not be found. Jun 07 08:39:14.619595 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:39:14.619595 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:39:14.619595 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:39:14.619595 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:39:14.619595 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:39:14.619595 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:39:14.619595 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:39:14.619595 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:39:14.619595 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e0e129e-3c0a-4372-a1e8-c508a3d27e77 could not be found. Jun 07 08:39:14.619595 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:39:14.620845 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-8bb05880-2cb4-448c-a88d-6988505cd823 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Returning 404 to user: Instance 6e0e129e-3c0a-4372-a1e8-c508a3d27e77 could not be found. {{(pid=129725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:39:14.620845 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-8bb05880-2cb4-448c-a88d-6988505cd823 tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77" status: 404 len: 111 microversion: 2.1 time: 0.035450 Jun 07 08:39:14.636605 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-990422dd-56a9-45a3-87ca-3f093a1b3d6d tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:14.637461 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-990422dd-56a9-45a3-87ca-3f093a1b3d6d tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] [instance: 6e0e129e-3c0a-4372-a1e8-c508a3d27e77] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:14.641495 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 80/151] 10.222.0.17 () {58 vars in 1238 bytes} [Tue Jun 7 08:39:14 2022] DELETE /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:39:14.653459 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-990422dd-56a9-45a3-87ca-3f093a1b3d6d tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:14.654114 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-990422dd-56a9-45a3-87ca-3f093a1b3d6d tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:14.655213 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-990422dd-56a9-45a3-87ca-3f093a1b3d6d tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:14.656158 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-990422dd-56a9-45a3-87ca-3f093a1b3d6d tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:14.706374 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.wsgi [None req-990422dd-56a9-45a3-87ca-3f093a1b3d6d tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] HTTP exception thrown: Instance 6e0e129e-3c0a-4372-a1e8-c508a3d27e77 could not be found. Jun 07 08:39:14.713924 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-990422dd-56a9-45a3-87ca-3f093a1b3d6d tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Request method failure captured: Jun 07 08:39:14.713924 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: request: GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 HTTP/1.1 Jun 07 08:39:14.713924 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept: application/json Jun 07 08:39:14.713924 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept-Encoding: identity Jun 07 08:39:14.713924 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Connection: close Jun 07 08:39:14.713924 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Length: 0 Jun 07 08:39:14.713924 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Type: application/json Jun 07 08:39:14.713924 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Host: 10.222.0.17 Jun 07 08:39:14.713924 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Openstack-System-Scope: None Jun 07 08:39:14.713924 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: User-Agent: python-urllib3/1.26.9 Jun 07 08:39:14.713924 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Auth-Token: gAAAAABinw5yiwg4S8CbgYcBFZzaDG-BfOURbEsGmaxlnXzfygysrEVLMAFvlUknZQ_0IquiS1sg4MD3mrIR7qxeue0B3yLy44DqXnVF92SqKOdHK5km35XGTpWN-Hv6kVL-BUukm7HQdRUNCK7LQyle12ywLg_NoPQFFEfLM4HWHJXrN33vCAQ Jun 07 08:39:14.713924 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Id: None Jun 07 08:39:14.713924 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Name: None Jun 07 08:39:14.713924 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Identity-Status: Confirmed Jun 07 08:39:14.713924 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Is-Admin-Project: True Jun 07 08:39:14.713924 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Id: default Jun 07 08:39:14.713924 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Name: Default Jun 07 08:39:14.713924 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Id: f26ee9298ae04230979b6a62d24be0e1 Jun 07 08:39:14.713924 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Name: tempest-DeleteServersTestJSON-1794422058 Jun 07 08:39:14.713924 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Role: reader,member Jun 07 08:39:14.713924 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Roles: reader,member Jun 07 08:39:14.715387 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f26ee9298ae04230979b6a62d24be0e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f26ee9298ae04230979b6a62d24be0e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f26ee9298ae04230979b6a62d24be0e1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f26ee9298ae04230979b6a62d24be0e1"}]}] Jun 07 08:39:14.715387 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant: tempest-DeleteServersTestJSON-1794422058 Jun 07 08:39:14.715387 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Id: f26ee9298ae04230979b6a62d24be0e1 Jun 07 08:39:14.715387 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Name: tempest-DeleteServersTestJSON-1794422058 Jun 07 08:39:14.715387 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User: tempest-DeleteServersTestJSON-1794422058-project Jun 07 08:39:14.715387 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Id: default Jun 07 08:39:14.715387 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Name: Default Jun 07 08:39:14.715387 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Id: ae58168dadc845daa0958cf975a41abd Jun 07 08:39:14.715387 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Name: tempest-DeleteServersTestJSON-1794422058-project Jun 07 08:39:14.715387 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: method: > Jun 07 08:39:14.715387 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: exception: Instance 6e0e129e-3c0a-4372-a1e8-c508a3d27e77 could not be found. Jun 07 08:39:14.715387 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: action_args: {'id': '6e0e129e-3c0a-4372-a1e8-c508a3d27e77'} Jun 07 08:39:14.716089 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:39:14.716089 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:39:14.716089 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:39:14.716089 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:39:14.716089 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:39:14.716089 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:39:14.716089 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:39:14.716089 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:39:14.716089 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:39:14.716089 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:39:14.716089 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e0e129e-3c0a-4372-a1e8-c508a3d27e77 could not be found. Jun 07 08:39:14.716089 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:39:14.716089 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:39:14.716089 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:39:14.716089 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:39:14.716089 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:39:14.716089 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:39:14.716089 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:39:14.716089 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:39:14.716089 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:39:14.717370 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:39:14.717370 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 08:39:14.717370 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 08:39:14.717370 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:39:14.717370 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:39:14.717370 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:39:14.717370 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:39:14.717370 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e0e129e-3c0a-4372-a1e8-c508a3d27e77 could not be found. Jun 07 08:39:14.717370 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:39:14.717370 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:39:14.717370 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:39:14.717370 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:39:14.717370 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:39:14.717370 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:39:14.717370 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:39:14.717370 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:39:14.717370 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e0e129e-3c0a-4372-a1e8-c508a3d27e77 could not be found. Jun 07 08:39:14.717370 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:39:14.726025 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-990422dd-56a9-45a3-87ca-3f093a1b3d6d tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] Returning 404 to user: Instance 6e0e129e-3c0a-4372-a1e8-c508a3d27e77 could not be found. {{(pid=129726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:39:14.729310 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-990422dd-56a9-45a3-87ca-3f093a1b3d6d tempest-DeleteServersTestJSON-1794422058 tempest-DeleteServersTestJSON-1794422058-project] 10.222.0.17 "GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77" status: 404 len: 111 microversion: 2.1 time: 0.104006 Jun 07 08:39:14.734476 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 72/152] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:14 2022] GET /compute/v2.1/servers/6e0e129e-3c0a-4372-a1e8-c508a3d27e77 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:39:15.282651 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-43508722-831c-4cd0-be65-f3f7c48153c6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:15.283425 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-43508722-831c-4cd0-be65-f3f7c48153c6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:15.285989 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_api:SELECT=62 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:39:15.292788 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-43508722-831c-4cd0-be65-f3f7c48153c6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:15.293332 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-43508722-831c-4cd0-be65-f3f7c48153c6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:15.294277 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-43508722-831c-4cd0-be65-f3f7c48153c6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:15.294813 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-43508722-831c-4cd0-be65-f3f7c48153c6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:15.513205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-43508722-831c-4cd0-be65-f3f7c48153c6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:15.522954 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-43508722-831c-4cd0-be65-f3f7c48153c6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1521 microversion: 2.1 time: 0.244228 Jun 07 08:39:15.532677 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 81/153] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:15 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:16.545214 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-ce8f78fe-3307-4ee3-bc28-07ccae79d711 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:16.560721 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-ce8f78fe-3307-4ee3-bc28-07ccae79d711 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:16.560721 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ce8f78fe-3307-4ee3-bc28-07ccae79d711 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:16.560721 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ce8f78fe-3307-4ee3-bc28-07ccae79d711 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:16.562056 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ce8f78fe-3307-4ee3-bc28-07ccae79d711 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:16.562598 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ce8f78fe-3307-4ee3-bc28-07ccae79d711 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:16.808257 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-ce8f78fe-3307-4ee3-bc28-07ccae79d711 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:16.817452 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-ce8f78fe-3307-4ee3-bc28-07ccae79d711 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1521 microversion: 2.1 time: 0.276411 Jun 07 08:39:16.818962 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 73/154] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:16 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:39:17.840384 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-73c3c0eb-8f3b-469a-916f-9dd5826fb6ed tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:17.840961 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-73c3c0eb-8f3b-469a-916f-9dd5826fb6ed tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:17.847807 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-73c3c0eb-8f3b-469a-916f-9dd5826fb6ed tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:17.848254 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-73c3c0eb-8f3b-469a-916f-9dd5826fb6ed tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:17.849117 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-73c3c0eb-8f3b-469a-916f-9dd5826fb6ed tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:17.849596 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-73c3c0eb-8f3b-469a-916f-9dd5826fb6ed tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:18.019683 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-73c3c0eb-8f3b-469a-916f-9dd5826fb6ed tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:18.029845 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-73c3c0eb-8f3b-469a-916f-9dd5826fb6ed tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1521 microversion: 2.1 time: 0.193719 Jun 07 08:39:18.036807 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 82/155] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:17 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:19.046761 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-74633709-4833-4450-b9f1-3a3911e9c086 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:19.047588 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-74633709-4833-4450-b9f1-3a3911e9c086 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:19.054502 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-74633709-4833-4450-b9f1-3a3911e9c086 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:19.055227 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-74633709-4833-4450-b9f1-3a3911e9c086 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:19.056202 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-74633709-4833-4450-b9f1-3a3911e9c086 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:19.056815 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-74633709-4833-4450-b9f1-3a3911e9c086 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:19.076272 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:39:19.284418 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-74633709-4833-4450-b9f1-3a3911e9c086 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:19.292001 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-74633709-4833-4450-b9f1-3a3911e9c086 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1521 microversion: 2.1 time: 0.249146 Jun 07 08:39:19.297471 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 74/156] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:19 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:20.316335 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-3425ac44-33fd-4032-b38e-1eb03cf4b645 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:20.317325 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-3425ac44-33fd-4032-b38e-1eb03cf4b645 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:20.328719 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3425ac44-33fd-4032-b38e-1eb03cf4b645 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:20.330066 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3425ac44-33fd-4032-b38e-1eb03cf4b645 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:20.336930 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3425ac44-33fd-4032-b38e-1eb03cf4b645 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:20.338914 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3425ac44-33fd-4032-b38e-1eb03cf4b645 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:20.889070 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-3425ac44-33fd-4032-b38e-1eb03cf4b645 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:20.897253 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-3425ac44-33fd-4032-b38e-1eb03cf4b645 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1521 microversion: 2.1 time: 0.587033 Jun 07 08:39:20.897826 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 83/157] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:20 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1521 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:21.915979 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-f812e6a0-b280-4101-a638-39bfdf03d8d2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:21.916659 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-f812e6a0-b280-4101-a638-39bfdf03d8d2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:21.926624 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f812e6a0-b280-4101-a638-39bfdf03d8d2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:21.927079 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f812e6a0-b280-4101-a638-39bfdf03d8d2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:21.927924 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f812e6a0-b280-4101-a638-39bfdf03d8d2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:21.928367 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f812e6a0-b280-4101-a638-39bfdf03d8d2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:22.180233 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-f812e6a0-b280-4101-a638-39bfdf03d8d2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:22.200640 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-f812e6a0-b280-4101-a638-39bfdf03d8d2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1521 microversion: 2.1 time: 0.290449 Jun 07 08:39:22.201562 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 75/158] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:21 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:23.219911 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-c4de23a4-c5a9-43fa-9832-34a249c3f620 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:23.220600 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-c4de23a4-c5a9-43fa-9832-34a249c3f620 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:23.228481 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c4de23a4-c5a9-43fa-9832-34a249c3f620 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:23.228872 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c4de23a4-c5a9-43fa-9832-34a249c3f620 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:23.229889 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c4de23a4-c5a9-43fa-9832-34a249c3f620 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:23.235914 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c4de23a4-c5a9-43fa-9832-34a249c3f620 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:23.451195 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-c4de23a4-c5a9-43fa-9832-34a249c3f620 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:23.460598 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-c4de23a4-c5a9-43fa-9832-34a249c3f620 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1521 microversion: 2.1 time: 0.244919 Jun 07 08:39:23.461729 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 84/159] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:23 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:24.480082 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-6c8e36b1-eb91-466c-b171-44487b73e2d8 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:24.483523 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-6c8e36b1-eb91-466c-b171-44487b73e2d8 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:24.494768 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6c8e36b1-eb91-466c-b171-44487b73e2d8 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:24.495250 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6c8e36b1-eb91-466c-b171-44487b73e2d8 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:24.496046 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6c8e36b1-eb91-466c-b171-44487b73e2d8 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:24.496889 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6c8e36b1-eb91-466c-b171-44487b73e2d8 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:24.823405 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-6c8e36b1-eb91-466c-b171-44487b73e2d8 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:24.854431 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-6c8e36b1-eb91-466c-b171-44487b73e2d8 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1521 microversion: 2.1 time: 0.380027 Jun 07 08:39:24.859932 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 76/160] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:24 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:25.878759 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-874998ab-14e0-4338-9ca6-f857d5a3f16c tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:25.880142 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-874998ab-14e0-4338-9ca6-f857d5a3f16c tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:25.891235 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-874998ab-14e0-4338-9ca6-f857d5a3f16c tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:25.895643 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-874998ab-14e0-4338-9ca6-f857d5a3f16c tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:25.901438 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-874998ab-14e0-4338-9ca6-f857d5a3f16c tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:25.903281 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-874998ab-14e0-4338-9ca6-f857d5a3f16c tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:26.172846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-874998ab-14e0-4338-9ca6-f857d5a3f16c tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:26.201480 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-874998ab-14e0-4338-9ca6-f857d5a3f16c tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1521 microversion: 2.1 time: 0.305032 Jun 07 08:39:26.207539 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 85/161] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:25 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:26.422050 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-cda0a128-0ab5-4424-a088-8b3937a4041a tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Action: 'create', calling method: .version_select at 0x7f7fecdc6af0>, body: {"keypair": {"name": "tempest-keypair-283053816", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXV3AlUtcNfwp3JAD7JXxPEohuW1arUbGPXO8lxCF19Q6+GVYb9/cHzqNJtxCQ/GCd4rR7VR0idpXaDOZL2o1oCZySXhmiweozEYu/laRjAr6QwU4jb5PzH750kwsdsaA=="}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:39:26.440468 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-cda0a128-0ab5-4424-a088-8b3937a4041a tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Getting quotas for project 5daf862eb4de4ea992b35692f003a25e. Resources: {'key_pairs'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 08:39:26.449838 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-cda0a128-0ab5-4424-a088-8b3937a4041a tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Getting quotas for user 4e5893f0909446ff82b5a72584ecae37 and project 5daf862eb4de4ea992b35692f003a25e. Resources: {'key_pairs'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 08:39:26.582959 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-cda0a128-0ab5-4424-a088-8b3937a4041a tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.385692 Jun 07 08:39:26.586187 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 77/162] 10.222.0.17 () {60 vars in 1158 bytes} [Tue Jun 7 08:39:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:39:27.223846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-cfc8cc88-026c-4fa2-a345-d907065923f1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:27.224623 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-cfc8cc88-026c-4fa2-a345-d907065923f1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:27.231728 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-cfc8cc88-026c-4fa2-a345-d907065923f1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:27.232171 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-cfc8cc88-026c-4fa2-a345-d907065923f1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:27.232932 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-cfc8cc88-026c-4fa2-a345-d907065923f1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:27.233387 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-cfc8cc88-026c-4fa2-a345-d907065923f1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:27.397313 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-cfc8cc88-026c-4fa2-a345-d907065923f1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:27.406120 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-cfc8cc88-026c-4fa2-a345-d907065923f1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1521 microversion: 2.1 time: 0.186084 Jun 07 08:39:27.406702 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 86/163] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:27 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:28.423495 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-e831ff70-7ee6-4b08-ad66-ecf054d3768a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:28.424459 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-e831ff70-7ee6-4b08-ad66-ecf054d3768a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:28.431121 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e831ff70-7ee6-4b08-ad66-ecf054d3768a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:28.431645 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e831ff70-7ee6-4b08-ad66-ecf054d3768a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:28.432856 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e831ff70-7ee6-4b08-ad66-ecf054d3768a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:28.433560 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e831ff70-7ee6-4b08-ad66-ecf054d3768a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:28.825263 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-e831ff70-7ee6-4b08-ad66-ecf054d3768a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:28.834299 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-e831ff70-7ee6-4b08-ad66-ecf054d3768a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1521 microversion: 2.1 time: 0.414156 Jun 07 08:39:28.834967 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 78/164] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:28 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1521 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:29.806268 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-8b66cd80-37c7-4c38-bb2e-5dcb3325e627 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-486370272", "imageRef": "c04b0a92-7675-47c3-bcc2-8a2a59b997c3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c643e61b-55cc-4612-8364-89139fdafa24"}], "security_groups": [{"name": "tempest-securitygroup--553785356"}], "key_name": "tempest-keypair-283053816", "user_data": "}} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:39:29.854196 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-4988190b-a614-4fe5-a608-029f92dce3f7 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:29.855124 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-4988190b-a614-4fe5-a608-029f92dce3f7 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:29.862355 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4988190b-a614-4fe5-a608-029f92dce3f7 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:29.862768 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4988190b-a614-4fe5-a608-029f92dce3f7 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:29.863670 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4988190b-a614-4fe5-a608-029f92dce3f7 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:29.864215 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4988190b-a614-4fe5-a608-029f92dce3f7 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:30.001098 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.network.neutron [None req-8b66cd80-37c7-4c38-bb2e-5dcb3325e627 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] validate_networks() for [('c643e61b-55cc-4612-8364-89139fdafa24', None, None, None, None, None)] {{(pid=129725) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 08:39:30.148800 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-4988190b-a614-4fe5-a608-029f92dce3f7 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:30.157014 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-4988190b-a614-4fe5-a608-029f92dce3f7 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1521 microversion: 2.1 time: 0.308595 Jun 07 08:39:30.160369 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 79/165] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:29 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:30.525066 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-8b66cd80-37c7-4c38-bb2e-5dcb3325e627 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Flavor limits 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 08:39:30.525537 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-8b66cd80-37c7-4c38-bb2e-5dcb3325e627 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Image limits 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 08:39:30.525962 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-8b66cd80-37c7-4c38-bb2e-5dcb3325e627 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Flavor pref 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 08:39:30.526367 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-8b66cd80-37c7-4c38-bb2e-5dcb3325e627 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Image pref 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 08:39:30.526777 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-8b66cd80-37c7-4c38-bb2e-5dcb3325e627 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 08:39:30.537737 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8b66cd80-37c7-4c38-bb2e-5dcb3325e627 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:30.538214 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8b66cd80-37c7-4c38-bb2e-5dcb3325e627 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:30.539024 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8b66cd80-37c7-4c38-bb2e-5dcb3325e627 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:30.539568 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8b66cd80-37c7-4c38-bb2e-5dcb3325e627 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:30.548451 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=100 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:39:30.563165 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.quota [None req-8b66cd80-37c7-4c38-bb2e-5dcb3325e627 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Getting quotas for project 5daf862eb4de4ea992b35692f003a25e. Resources: {'ram', 'cores', 'instances'} {{(pid=129725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 08:39:30.569565 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.quota [None req-8b66cd80-37c7-4c38-bb2e-5dcb3325e627 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Getting quotas for user 4e5893f0909446ff82b5a72584ecae37 and project 5daf862eb4de4ea992b35692f003a25e. Resources: {'ram', 'cores', 'instances'} {{(pid=129725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 08:39:30.583273 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-8b66cd80-37c7-4c38-bb2e-5dcb3325e627 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Going to run 1 instances... {{(pid=129725) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 08:39:30.586700 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-8b66cd80-37c7-4c38-bb2e-5dcb3325e627 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c04b0a92-7675-47c3-bcc2-8a2a59b997c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 08:39:30.743587 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-8b66cd80-37c7-4c38-bb2e-5dcb3325e627 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.942836 Jun 07 08:39:30.744224 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 87/166] 10.222.0.17 () {60 vars in 1146 bytes} [Tue Jun 7 08:39:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 08:39:30.754221 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-039b8ecf-250a-447c-aced-319f69dbbdc3 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:30.754842 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-039b8ecf-250a-447c-aced-319f69dbbdc3 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:30.817739 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-039b8ecf-250a-447c-aced-319f69dbbdc3 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:30.826434 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-039b8ecf-250a-447c-aced-319f69dbbdc3 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1236 microversion: 2.1 time: 0.075868 Jun 07 08:39:30.837296 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 80/167] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:30 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1236 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:31.184411 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-960d0a46-d7cf-4237-a86b-256ca858a97a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:31.184411 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-960d0a46-d7cf-4237-a86b-256ca858a97a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:31.186988 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-960d0a46-d7cf-4237-a86b-256ca858a97a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:31.187436 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-960d0a46-d7cf-4237-a86b-256ca858a97a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:31.188204 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-960d0a46-d7cf-4237-a86b-256ca858a97a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:31.188709 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-960d0a46-d7cf-4237-a86b-256ca858a97a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:31.329921 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-960d0a46-d7cf-4237-a86b-256ca858a97a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:31.337854 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-960d0a46-d7cf-4237-a86b-256ca858a97a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1521 microversion: 2.1 time: 0.163483 Jun 07 08:39:31.338430 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 88/168] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:31 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:39:31.843783 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-c161ac2f-c3f6-4107-b6e4-9d817574e69d tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:31.844485 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-c161ac2f-c3f6-4107-b6e4-9d817574e69d tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:31.903881 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-c161ac2f-c3f6-4107-b6e4-9d817574e69d tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:31.913269 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-c161ac2f-c3f6-4107-b6e4-9d817574e69d tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1236 microversion: 2.1 time: 0.073289 Jun 07 08:39:31.913839 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 81/169] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:31 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1236 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:32.356331 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-3eb3b9b9-dea9-46f7-9a49-addd816b07b6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:32.362485 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-3eb3b9b9-dea9-46f7-9a49-addd816b07b6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:32.364185 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3eb3b9b9-dea9-46f7-9a49-addd816b07b6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:32.364894 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3eb3b9b9-dea9-46f7-9a49-addd816b07b6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:32.367015 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3eb3b9b9-dea9-46f7-9a49-addd816b07b6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:32.367534 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3eb3b9b9-dea9-46f7-9a49-addd816b07b6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:32.510367 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-3eb3b9b9-dea9-46f7-9a49-addd816b07b6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:32.518912 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-3eb3b9b9-dea9-46f7-9a49-addd816b07b6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1521 microversion: 2.1 time: 0.166685 Jun 07 08:39:32.519576 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 89/170] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:32 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:32.931420 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-4094fa0f-7a9e-4038-bc5c-0219b3e504e7 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:32.932102 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-4094fa0f-7a9e-4038-bc5c-0219b3e504e7 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:32.938547 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4094fa0f-7a9e-4038-bc5c-0219b3e504e7 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:32.938999 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4094fa0f-7a9e-4038-bc5c-0219b3e504e7 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:32.939774 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4094fa0f-7a9e-4038-bc5c-0219b3e504e7 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:32.940245 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4094fa0f-7a9e-4038-bc5c-0219b3e504e7 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:33.009909 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-4094fa0f-7a9e-4038-bc5c-0219b3e504e7 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:33.017685 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-4094fa0f-7a9e-4038-bc5c-0219b3e504e7 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1240 microversion: 2.1 time: 0.090803 Jun 07 08:39:33.018243 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 82/171] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:32 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1240 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:33.538410 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-2f2aff87-ca14-45fa-b639-077023a121bd tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:33.539029 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-2f2aff87-ca14-45fa-b639-077023a121bd tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:33.545855 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2f2aff87-ca14-45fa-b639-077023a121bd tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:33.546306 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2f2aff87-ca14-45fa-b639-077023a121bd tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:33.547073 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2f2aff87-ca14-45fa-b639-077023a121bd tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:33.547718 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2f2aff87-ca14-45fa-b639-077023a121bd tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:33.688305 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-2f2aff87-ca14-45fa-b639-077023a121bd tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:33.697822 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-2f2aff87-ca14-45fa-b639-077023a121bd tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1521 microversion: 2.1 time: 0.164866 Jun 07 08:39:33.698389 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 90/172] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:33 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:34.034898 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-c1daf33e-eea8-4af6-b073-bf8b63a4b587 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:34.035526 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-c1daf33e-eea8-4af6-b073-bf8b63a4b587 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:34.042523 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c1daf33e-eea8-4af6-b073-bf8b63a4b587 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:34.042973 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c1daf33e-eea8-4af6-b073-bf8b63a4b587 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:34.043742 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c1daf33e-eea8-4af6-b073-bf8b63a4b587 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:34.044211 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c1daf33e-eea8-4af6-b073-bf8b63a4b587 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:34.105597 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-c1daf33e-eea8-4af6-b073-bf8b63a4b587 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:34.113052 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-c1daf33e-eea8-4af6-b073-bf8b63a4b587 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1232 microversion: 2.1 time: 0.082298 Jun 07 08:39:34.113642 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 83/173] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:34 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1232 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:34.715540 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-23957303-2b13-416d-b7eb-c26c218d522a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:34.716149 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-23957303-2b13-416d-b7eb-c26c218d522a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:34.722964 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-23957303-2b13-416d-b7eb-c26c218d522a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:34.723420 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-23957303-2b13-416d-b7eb-c26c218d522a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:34.724373 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-23957303-2b13-416d-b7eb-c26c218d522a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:34.724625 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-23957303-2b13-416d-b7eb-c26c218d522a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:34.858755 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-23957303-2b13-416d-b7eb-c26c218d522a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:34.866324 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-23957303-2b13-416d-b7eb-c26c218d522a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1521 microversion: 2.1 time: 0.154689 Jun 07 08:39:34.866884 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 91/174] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:34 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:35.131571 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-41b8f468-d7c4-4494-afc4-0a32d069e770 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:35.132192 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-41b8f468-d7c4-4494-afc4-0a32d069e770 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:35.138327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-41b8f468-d7c4-4494-afc4-0a32d069e770 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:35.138775 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-41b8f468-d7c4-4494-afc4-0a32d069e770 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:35.139550 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-41b8f468-d7c4-4494-afc4-0a32d069e770 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:35.139999 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-41b8f468-d7c4-4494-afc4-0a32d069e770 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:35.205493 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-41b8f468-d7c4-4494-afc4-0a32d069e770 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:35.213452 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-41b8f468-d7c4-4494-afc4-0a32d069e770 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1288 microversion: 2.1 time: 0.086371 Jun 07 08:39:35.214030 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 84/175] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:35 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1288 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:35.887070 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-c3754681-d184-4866-9f18-d77a23a8fba5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:35.887740 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-c3754681-d184-4866-9f18-d77a23a8fba5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:35.894118 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c3754681-d184-4866-9f18-d77a23a8fba5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:35.894570 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c3754681-d184-4866-9f18-d77a23a8fba5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:35.895340 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c3754681-d184-4866-9f18-d77a23a8fba5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:35.895800 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c3754681-d184-4866-9f18-d77a23a8fba5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:36.048062 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-c3754681-d184-4866-9f18-d77a23a8fba5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:36.056116 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-c3754681-d184-4866-9f18-d77a23a8fba5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1521 microversion: 2.1 time: 0.173398 Jun 07 08:39:36.056696 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 92/176] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:35 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:36.230739 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-0fb77fda-8e25-482d-a097-81a30be01aac tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:36.231290 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-0fb77fda-8e25-482d-a097-81a30be01aac tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:36.237414 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0fb77fda-8e25-482d-a097-81a30be01aac tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:36.237854 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0fb77fda-8e25-482d-a097-81a30be01aac tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:36.238616 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0fb77fda-8e25-482d-a097-81a30be01aac tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:36.239050 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0fb77fda-8e25-482d-a097-81a30be01aac tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:36.321021 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-0fb77fda-8e25-482d-a097-81a30be01aac tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:36.329428 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-0fb77fda-8e25-482d-a097-81a30be01aac tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1296 microversion: 2.1 time: 0.102699 Jun 07 08:39:36.330022 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 85/177] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:36 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1296 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:37.073523 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-e0b727e9-7a37-4cc8-8340-ddbe58913443 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:37.074402 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-e0b727e9-7a37-4cc8-8340-ddbe58913443 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:37.080654 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e0b727e9-7a37-4cc8-8340-ddbe58913443 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:37.081138 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e0b727e9-7a37-4cc8-8340-ddbe58913443 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:37.081910 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e0b727e9-7a37-4cc8-8340-ddbe58913443 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:37.082346 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e0b727e9-7a37-4cc8-8340-ddbe58913443 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:37.248206 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-e0b727e9-7a37-4cc8-8340-ddbe58913443 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:37.259651 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-e0b727e9-7a37-4cc8-8340-ddbe58913443 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1521 microversion: 2.1 time: 0.189866 Jun 07 08:39:37.260499 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 93/178] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:37 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:39:37.349264 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-4cbd54d3-fe85-43a2-a7d6-dea29bfe8cbf tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:37.349264 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-4cbd54d3-fe85-43a2-a7d6-dea29bfe8cbf tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:37.366027 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4cbd54d3-fe85-43a2-a7d6-dea29bfe8cbf tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:37.366966 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4cbd54d3-fe85-43a2-a7d6-dea29bfe8cbf tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:37.368027 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4cbd54d3-fe85-43a2-a7d6-dea29bfe8cbf tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:37.368603 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4cbd54d3-fe85-43a2-a7d6-dea29bfe8cbf tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:37.460573 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-4cbd54d3-fe85-43a2-a7d6-dea29bfe8cbf tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:37.467961 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-4cbd54d3-fe85-43a2-a7d6-dea29bfe8cbf tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1294 microversion: 2.1 time: 0.123982 Jun 07 08:39:37.470305 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 86/179] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:37 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1294 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:39:38.278572 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-9091b905-1f05-4924-b3cd-c3dc3390b15b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:38.279096 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-9091b905-1f05-4924-b3cd-c3dc3390b15b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:38.285533 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9091b905-1f05-4924-b3cd-c3dc3390b15b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:38.286235 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9091b905-1f05-4924-b3cd-c3dc3390b15b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:38.287615 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9091b905-1f05-4924-b3cd-c3dc3390b15b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:38.288211 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9091b905-1f05-4924-b3cd-c3dc3390b15b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:38.460634 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-9091b905-1f05-4924-b3cd-c3dc3390b15b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:38.468930 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-9091b905-1f05-4924-b3cd-c3dc3390b15b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1501 microversion: 2.1 time: 0.194718 Jun 07 08:39:38.473364 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 94/180] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:38 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1501 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:38.485618 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-9b21001f-9de0-47f2-8ae4-a1e55d8847be tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:38.486575 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-9b21001f-9de0-47f2-8ae4-a1e55d8847be tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:38.493661 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-de114515-9491-4cf5-a96f-988b56b1a15e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:38.494037 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9b21001f-9de0-47f2-8ae4-a1e55d8847be tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:38.495544 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-de114515-9491-4cf5-a96f-988b56b1a15e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:38.495657 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9b21001f-9de0-47f2-8ae4-a1e55d8847be tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:38.497431 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9b21001f-9de0-47f2-8ae4-a1e55d8847be tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:38.497892 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9b21001f-9de0-47f2-8ae4-a1e55d8847be tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:38.504983 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-de114515-9491-4cf5-a96f-988b56b1a15e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:38.506123 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-de114515-9491-4cf5-a96f-988b56b1a15e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:38.506923 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-de114515-9491-4cf5-a96f-988b56b1a15e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:38.507358 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-de114515-9491-4cf5-a96f-988b56b1a15e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:38.728394 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-9b21001f-9de0-47f2-8ae4-a1e55d8847be tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:38.736955 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-9b21001f-9de0-47f2-8ae4-a1e55d8847be tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1515 microversion: 2.1 time: 0.255668 Jun 07 08:39:38.737622 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 87/181] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:38 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1515 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:38.741519 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-de114515-9491-4cf5-a96f-988b56b1a15e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:38.766440 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-de114515-9491-4cf5-a96f-988b56b1a15e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1361 microversion: 2.1 time: 0.280145 Jun 07 08:39:38.772431 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 95/182] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:38 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1361 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:38.852877 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-723ac65c-b394-4b06-8740-16ee4e709dee req-1b49bf7a-265a-4e96-84ac-1c68a6e7c7f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7", "tag": "cb22b910-c497-4ee0-831c-3c7b0d2ea236"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:39:38.866700 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-723ac65c-b394-4b06-8740-16ee4e709dee req-1b49bf7a-265a-4e96-84ac-1c68a6e7c7f7 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:38.867145 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-723ac65c-b394-4b06-8740-16ee4e709dee req-1b49bf7a-265a-4e96-84ac-1c68a6e7c7f7 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:38.883907 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-723ac65c-b394-4b06-8740-16ee4e709dee req-1b49bf7a-265a-4e96-84ac-1c68a6e7c7f7 service nova] Creating event network-changed:cb22b910-c497-4ee0-831c-3c7b0d2ea236 for instance 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 on hv-cinder-74014 Jun 07 08:39:38.892585 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-723ac65c-b394-4b06-8740-16ee4e709dee req-1b49bf7a-265a-4e96-84ac-1c68a6e7c7f7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043988 Jun 07 08:39:38.894178 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 88/183] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:39:39.787295 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-76750a45-cfe6-4caa-9794-83f3dcabea94 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:39.788067 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-76750a45-cfe6-4caa-9794-83f3dcabea94 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:39.797058 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-76750a45-cfe6-4caa-9794-83f3dcabea94 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:39.797058 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-76750a45-cfe6-4caa-9794-83f3dcabea94 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:39.797476 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-76750a45-cfe6-4caa-9794-83f3dcabea94 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:39.798942 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-76750a45-cfe6-4caa-9794-83f3dcabea94 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:39.962105 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-76750a45-cfe6-4caa-9794-83f3dcabea94 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:39.971017 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-76750a45-cfe6-4caa-9794-83f3dcabea94 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1361 microversion: 2.1 time: 0.188958 Jun 07 08:39:39.973330 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 96/184] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:39 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1361 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:40.814910 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-d8e3eb42-ab79-4556-bddf-45498353806d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:39:40.815976 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-d8e3eb42-ab79-4556-bddf-45498353806d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:40.822682 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d8e3eb42-ab79-4556-bddf-45498353806d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:40.823133 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d8e3eb42-ab79-4556-bddf-45498353806d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:40.823894 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d8e3eb42-ab79-4556-bddf-45498353806d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:40.824331 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d8e3eb42-ab79-4556-bddf-45498353806d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:40.847143 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.objects.instance [None req-d8e3eb42-ab79-4556-bddf-45498353806d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lazy-loading 'flavor' on Instance uuid d40b0293-76f4-4ef2-9bfa-dda971ade7ea {{(pid=129726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:39:40.987729 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-7c75a698-f188-46fc-a8af-6e14d076493d tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:40.989016 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-7c75a698-f188-46fc-a8af-6e14d076493d tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:40.991575 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell0:SELECT=2 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:39:40.992240 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell0:SELECT=6 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:39:40.997668 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7c75a698-f188-46fc-a8af-6e14d076493d tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:40.998114 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7c75a698-f188-46fc-a8af-6e14d076493d tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:40.998886 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7c75a698-f188-46fc-a8af-6e14d076493d tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:40.999327 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7c75a698-f188-46fc-a8af-6e14d076493d tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:41.143279 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-7c75a698-f188-46fc-a8af-6e14d076493d tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:41.152577 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-7c75a698-f188-46fc-a8af-6e14d076493d tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1361 microversion: 2.1 time: 0.168572 Jun 07 08:39:41.155399 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 97/185] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:40 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:39:41.271721 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-d8e3eb42-ab79-4556-bddf-45498353806d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "POST /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea/action" status: 200 len: 32 microversion: 2.1 time: 0.460716 Jun 07 08:39:41.272896 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 89/186] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jun 7 08:39:40 2022] POST /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea/action => generated 32 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 08:39:41.284191 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-985413bd-e413-4b46-80f8-6e9e2ba6faf6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:41.284800 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-985413bd-e413-4b46-80f8-6e9e2ba6faf6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:41.303143 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-985413bd-e413-4b46-80f8-6e9e2ba6faf6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:41.303621 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-985413bd-e413-4b46-80f8-6e9e2ba6faf6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:41.304412 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-985413bd-e413-4b46-80f8-6e9e2ba6faf6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:41.304853 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-985413bd-e413-4b46-80f8-6e9e2ba6faf6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:41.454065 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-985413bd-e413-4b46-80f8-6e9e2ba6faf6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:41.467101 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-985413bd-e413-4b46-80f8-6e9e2ba6faf6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.187204 Jun 07 08:39:41.467746 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 98/187] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:41 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:42.172250 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell0:SELECT=8 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:39:42.173279 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-952052e4-cb01-4a27-9a37-59237b6ac7ef tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:42.173365 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-952052e4-cb01-4a27-9a37-59237b6ac7ef tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:42.176278 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:39:42.185159 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-952052e4-cb01-4a27-9a37-59237b6ac7ef tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:42.185630 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-952052e4-cb01-4a27-9a37-59237b6ac7ef tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:42.186415 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-952052e4-cb01-4a27-9a37-59237b6ac7ef tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:42.186861 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-952052e4-cb01-4a27-9a37-59237b6ac7ef tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:42.362221 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-952052e4-cb01-4a27-9a37-59237b6ac7ef tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:42.371171 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-952052e4-cb01-4a27-9a37-59237b6ac7ef tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1361 microversion: 2.1 time: 0.204073 Jun 07 08:39:42.372810 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 90/188] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:42 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1361 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:42.484293 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-d8415045-721d-4d59-98ee-7e43abaad63d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:42.484982 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-d8415045-721d-4d59-98ee-7e43abaad63d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:42.496326 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d8415045-721d-4d59-98ee-7e43abaad63d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:42.496784 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d8415045-721d-4d59-98ee-7e43abaad63d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:42.497617 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d8415045-721d-4d59-98ee-7e43abaad63d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:42.498055 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d8415045-721d-4d59-98ee-7e43abaad63d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:42.669597 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-d8415045-721d-4d59-98ee-7e43abaad63d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:42.683470 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-d8415045-721d-4d59-98ee-7e43abaad63d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.202063 Jun 07 08:39:42.683990 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 99/189] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:42 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:43.387693 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-59aed9f4-57a2-4b3f-ab3b-2663c3c2f276 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:43.388500 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-59aed9f4-57a2-4b3f-ab3b-2663c3c2f276 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:43.396261 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-59aed9f4-57a2-4b3f-ab3b-2663c3c2f276 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:43.396722 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-59aed9f4-57a2-4b3f-ab3b-2663c3c2f276 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:43.397547 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-59aed9f4-57a2-4b3f-ab3b-2663c3c2f276 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:43.398019 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-59aed9f4-57a2-4b3f-ab3b-2663c3c2f276 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:43.574769 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-59aed9f4-57a2-4b3f-ab3b-2663c3c2f276 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:43.582789 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-59aed9f4-57a2-4b3f-ab3b-2663c3c2f276 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1361 microversion: 2.1 time: 0.198852 Jun 07 08:39:43.583543 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 91/190] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:43 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1361 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:39:43.700009 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-05ff3407-3e83-46c8-86aa-c18c28468daa tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:43.701913 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-05ff3407-3e83-46c8-86aa-c18c28468daa tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:43.709111 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-05ff3407-3e83-46c8-86aa-c18c28468daa tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:43.709572 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-05ff3407-3e83-46c8-86aa-c18c28468daa tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:43.710359 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-05ff3407-3e83-46c8-86aa-c18c28468daa tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:43.710798 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-05ff3407-3e83-46c8-86aa-c18c28468daa tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:43.879742 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-05ff3407-3e83-46c8-86aa-c18c28468daa tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:43.894516 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-05ff3407-3e83-46c8-86aa-c18c28468daa tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.194308 Jun 07 08:39:43.894516 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 100/191] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:43 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:44.608656 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-b4b059bf-3169-414d-b790-c469745510df tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:44.614346 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-b4b059bf-3169-414d-b790-c469745510df tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:44.628838 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b4b059bf-3169-414d-b790-c469745510df tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:44.629828 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b4b059bf-3169-414d-b790-c469745510df tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:44.631698 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b4b059bf-3169-414d-b790-c469745510df tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:44.632652 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b4b059bf-3169-414d-b790-c469745510df tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:44.799773 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-b4b059bf-3169-414d-b790-c469745510df tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:44.806094 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:39:44.815124 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-b4b059bf-3169-414d-b790-c469745510df tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1361 microversion: 2.1 time: 0.212842 Jun 07 08:39:44.818697 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 92/192] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:44 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1361 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:44.909680 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-660cc690-e6d5-47fe-a743-f03ee1058908 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:44.910843 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-660cc690-e6d5-47fe-a743-f03ee1058908 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:44.926557 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-660cc690-e6d5-47fe-a743-f03ee1058908 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:44.927563 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-660cc690-e6d5-47fe-a743-f03ee1058908 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:44.928338 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-660cc690-e6d5-47fe-a743-f03ee1058908 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:44.928882 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-660cc690-e6d5-47fe-a743-f03ee1058908 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:45.117691 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-660cc690-e6d5-47fe-a743-f03ee1058908 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:45.129366 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-660cc690-e6d5-47fe-a743-f03ee1058908 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.223755 Jun 07 08:39:45.130406 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 101/193] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:44 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:45.836579 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-959292c7-a5ee-4275-a040-69f1207932ee tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:45.837234 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-959292c7-a5ee-4275-a040-69f1207932ee tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:45.844583 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-959292c7-a5ee-4275-a040-69f1207932ee tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:45.845067 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-959292c7-a5ee-4275-a040-69f1207932ee tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:45.845847 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-959292c7-a5ee-4275-a040-69f1207932ee tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:45.846477 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-959292c7-a5ee-4275-a040-69f1207932ee tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:46.034292 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-959292c7-a5ee-4275-a040-69f1207932ee tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:46.056226 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-959292c7-a5ee-4275-a040-69f1207932ee tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1361 microversion: 2.1 time: 0.226309 Jun 07 08:39:46.078419 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 93/194] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:45 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1361 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:46.078504 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-e43d7fc6-ed7f-4321-b154-e00bc8e2f06b req-f125e7ef-7d0f-4135-b80a-9cccdd132758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7", "name": "network-vif-plugged", "status": "completed", "tag": "cb22b910-c497-4ee0-831c-3c7b0d2ea236"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:39:46.078504 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-e43d7fc6-ed7f-4321-b154-e00bc8e2f06b req-f125e7ef-7d0f-4135-b80a-9cccdd132758 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:46.078504 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-e43d7fc6-ed7f-4321-b154-e00bc8e2f06b req-f125e7ef-7d0f-4135-b80a-9cccdd132758 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:46.087681 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-e43d7fc6-ed7f-4321-b154-e00bc8e2f06b req-f125e7ef-7d0f-4135-b80a-9cccdd132758 service nova] Creating event network-vif-plugged:cb22b910-c497-4ee0-831c-3c7b0d2ea236 for instance 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 on hv-cinder-74014 Jun 07 08:39:46.093229 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-e43d7fc6-ed7f-4321-b154-e00bc8e2f06b req-f125e7ef-7d0f-4135-b80a-9cccdd132758 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036271 Jun 07 08:39:46.094438 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 102/195] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:39:46.146826 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-1bb8b7be-9e23-420e-ae73-2e555daed084 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:46.147527 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-1bb8b7be-9e23-420e-ae73-2e555daed084 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:46.155421 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1bb8b7be-9e23-420e-ae73-2e555daed084 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:46.158968 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1bb8b7be-9e23-420e-ae73-2e555daed084 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:46.158968 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1bb8b7be-9e23-420e-ae73-2e555daed084 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:46.158968 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1bb8b7be-9e23-420e-ae73-2e555daed084 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:46.298276 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-1bb8b7be-9e23-420e-ae73-2e555daed084 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:46.306466 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-1bb8b7be-9e23-420e-ae73-2e555daed084 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.164299 Jun 07 08:39:46.307144 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 94/196] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:46 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:47.089850 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-bdefeb7e-bef5-4266-8a0f-a02dbae45d99 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:47.090523 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-bdefeb7e-bef5-4266-8a0f-a02dbae45d99 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:47.097456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-bdefeb7e-bef5-4266-8a0f-a02dbae45d99 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:47.098139 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-bdefeb7e-bef5-4266-8a0f-a02dbae45d99 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:47.099866 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-bdefeb7e-bef5-4266-8a0f-a02dbae45d99 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:47.100648 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-bdefeb7e-bef5-4266-8a0f-a02dbae45d99 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:47.252250 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-bdefeb7e-bef5-4266-8a0f-a02dbae45d99 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:47.260240 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-bdefeb7e-bef5-4266-8a0f-a02dbae45d99 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1361 microversion: 2.1 time: 0.175753 Jun 07 08:39:47.260826 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 103/197] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:47 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:47.323913 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-2945052e-3e05-46d7-ae0b-a5973aa2fb69 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:47.324528 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-2945052e-3e05-46d7-ae0b-a5973aa2fb69 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:47.330698 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2945052e-3e05-46d7-ae0b-a5973aa2fb69 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:47.331150 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2945052e-3e05-46d7-ae0b-a5973aa2fb69 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:47.337885 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2945052e-3e05-46d7-ae0b-a5973aa2fb69 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:47.337885 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2945052e-3e05-46d7-ae0b-a5973aa2fb69 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:47.529772 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-2945052e-3e05-46d7-ae0b-a5973aa2fb69 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:47.537688 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-2945052e-3e05-46d7-ae0b-a5973aa2fb69 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.217928 Jun 07 08:39:47.538467 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 95/198] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:47 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:48.277716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-a1d83be6-30d8-417a-9c0d-d58341d4d4ef tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:48.278337 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-a1d83be6-30d8-417a-9c0d-d58341d4d4ef tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:48.280930 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:39:48.286048 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a1d83be6-30d8-417a-9c0d-d58341d4d4ef tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:48.286552 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a1d83be6-30d8-417a-9c0d-d58341d4d4ef tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:48.287325 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a1d83be6-30d8-417a-9c0d-d58341d4d4ef tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:48.287754 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a1d83be6-30d8-417a-9c0d-d58341d4d4ef tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:48.427250 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-a1d83be6-30d8-417a-9c0d-d58341d4d4ef tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:48.434970 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-a1d83be6-30d8-417a-9c0d-d58341d4d4ef tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1361 microversion: 2.1 time: 0.161079 Jun 07 08:39:48.435542 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 104/199] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:48 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:48.555661 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-f0426356-10c6-40e4-b4bf-588161e5d139 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:48.556319 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-f0426356-10c6-40e4-b4bf-588161e5d139 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:48.562399 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f0426356-10c6-40e4-b4bf-588161e5d139 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:48.562844 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f0426356-10c6-40e4-b4bf-588161e5d139 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:48.563591 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f0426356-10c6-40e4-b4bf-588161e5d139 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:48.564021 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f0426356-10c6-40e4-b4bf-588161e5d139 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:48.701633 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-f0426356-10c6-40e4-b4bf-588161e5d139 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:48.711704 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-f0426356-10c6-40e4-b4bf-588161e5d139 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.158820 Jun 07 08:39:48.712312 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 96/200] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:48 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:49.451927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-476dbb8b-b5cf-42e5-99be-4c0dadeda694 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:49.452662 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-476dbb8b-b5cf-42e5-99be-4c0dadeda694 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:49.459903 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-476dbb8b-b5cf-42e5-99be-4c0dadeda694 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:49.466460 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-476dbb8b-b5cf-42e5-99be-4c0dadeda694 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:49.466460 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-476dbb8b-b5cf-42e5-99be-4c0dadeda694 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:49.466460 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-476dbb8b-b5cf-42e5-99be-4c0dadeda694 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:49.466460 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=100 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:39:49.605858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-476dbb8b-b5cf-42e5-99be-4c0dadeda694 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:49.613244 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-476dbb8b-b5cf-42e5-99be-4c0dadeda694 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1361 microversion: 2.1 time: 0.165389 Jun 07 08:39:49.613832 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 105/201] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:49 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:49.729938 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-4d343105-09d0-48e4-881e-33eec5de6311 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:49.734015 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-4d343105-09d0-48e4-881e-33eec5de6311 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:49.736944 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4d343105-09d0-48e4-881e-33eec5de6311 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:49.737413 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4d343105-09d0-48e4-881e-33eec5de6311 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:49.738189 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4d343105-09d0-48e4-881e-33eec5de6311 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:49.738626 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4d343105-09d0-48e4-881e-33eec5de6311 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:49.920220 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-bdddc062-8e71-4b1b-bbfe-f187421ec0e4 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1022655154", "imageRef": "c04b0a92-7675-47c3-bcc2-8a2a59b997c3", "flavorRef": "452", "networks": [{"uuid": "f4edf7e7-0962-4b4e-9f17-0754b12271de"}]}} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:39:49.929550 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-4d343105-09d0-48e4-881e-33eec5de6311 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:49.937101 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-4d343105-09d0-48e4-881e-33eec5de6311 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.210909 Jun 07 08:39:49.937682 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 97/202] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:49 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:49.975700 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.network.neutron [None req-bdddc062-8e71-4b1b-bbfe-f187421ec0e4 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] validate_networks() for [('f4edf7e7-0962-4b4e-9f17-0754b12271de', None, None, None, None, None)] {{(pid=129725) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 08:39:50.606036 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-bdddc062-8e71-4b1b-bbfe-f187421ec0e4 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Flavor limits 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 08:39:50.606528 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-bdddc062-8e71-4b1b-bbfe-f187421ec0e4 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Image limits 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 08:39:50.606909 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-bdddc062-8e71-4b1b-bbfe-f187421ec0e4 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Flavor pref 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 08:39:50.607319 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-bdddc062-8e71-4b1b-bbfe-f187421ec0e4 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Image pref 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 08:39:50.607723 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-bdddc062-8e71-4b1b-bbfe-f187421ec0e4 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 08:39:50.617767 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-bdddc062-8e71-4b1b-bbfe-f187421ec0e4 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:50.618207 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-bdddc062-8e71-4b1b-bbfe-f187421ec0e4 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:50.618994 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-bdddc062-8e71-4b1b-bbfe-f187421ec0e4 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:50.619447 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-bdddc062-8e71-4b1b-bbfe-f187421ec0e4 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:50.631253 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-670dcb8a-00a2-47ed-9e89-2c83db01591e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:50.632300 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-670dcb8a-00a2-47ed-9e89-2c83db01591e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:50.638334 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.quota [None req-bdddc062-8e71-4b1b-bbfe-f187421ec0e4 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Getting quotas for project be66894579564c8584bb7a4ff489ea22. Resources: {'ram', 'cores', 'instances'} {{(pid=129725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 08:39:50.639520 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-670dcb8a-00a2-47ed-9e89-2c83db01591e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:50.640138 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-670dcb8a-00a2-47ed-9e89-2c83db01591e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:50.640915 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-670dcb8a-00a2-47ed-9e89-2c83db01591e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:50.641375 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-670dcb8a-00a2-47ed-9e89-2c83db01591e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:50.642919 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.quota [None req-bdddc062-8e71-4b1b-bbfe-f187421ec0e4 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Getting quotas for user 489306774e664047a2a5629048455686 and project be66894579564c8584bb7a4ff489ea22. Resources: {'ram', 'cores', 'instances'} {{(pid=129725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 08:39:50.654448 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-bdddc062-8e71-4b1b-bbfe-f187421ec0e4 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Going to run 1 instances... {{(pid=129725) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 08:39:50.657205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-bdddc062-8e71-4b1b-bbfe-f187421ec0e4 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: 96c29268-a0e7-41b2-9a4e-145dc92445f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c04b0a92-7675-47c3-bcc2-8a2a59b997c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 08:39:50.805134 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-bdddc062-8e71-4b1b-bbfe-f187421ec0e4 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.889023 Jun 07 08:39:50.805872 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 106/203] 10.222.0.17 () {60 vars in 1146 bytes} [Tue Jun 7 08:39:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 08:39:50.826282 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-fa6004c4-4e3c-4eb8-9f7c-c87346ef517a tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:50.827365 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-fa6004c4-4e3c-4eb8-9f7c-c87346ef517a tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: 96c29268-a0e7-41b2-9a4e-145dc92445f1] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:50.892723 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-fa6004c4-4e3c-4eb8-9f7c-c87346ef517a tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:50.902747 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-fa6004c4-4e3c-4eb8-9f7c-c87346ef517a tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1" status: 200 len: 1214 microversion: 2.1 time: 0.090289 Jun 07 08:39:50.903923 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 107/204] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:50 2022] GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1 => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:50.954887 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-7ae20b39-d6db-492e-8e45-a132615ba917 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:50.955810 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-7ae20b39-d6db-492e-8e45-a132615ba917 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:50.964024 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7ae20b39-d6db-492e-8e45-a132615ba917 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:50.964311 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7ae20b39-d6db-492e-8e45-a132615ba917 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:50.965396 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7ae20b39-d6db-492e-8e45-a132615ba917 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:50.965995 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7ae20b39-d6db-492e-8e45-a132615ba917 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:51.051638 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-670dcb8a-00a2-47ed-9e89-2c83db01591e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:51.064803 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-670dcb8a-00a2-47ed-9e89-2c83db01591e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1546 microversion: 2.1 time: 0.438327 Jun 07 08:39:51.065470 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 98/205] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:50 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1546 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:39:51.092201 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-70856955-bd5d-4ee1-a866-6afba72e103e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:51.093296 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-70856955-bd5d-4ee1-a866-6afba72e103e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:51.109279 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-70856955-bd5d-4ee1-a866-6afba72e103e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:51.109743 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-70856955-bd5d-4ee1-a866-6afba72e103e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:51.110567 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-70856955-bd5d-4ee1-a866-6afba72e103e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:51.111003 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-70856955-bd5d-4ee1-a866-6afba72e103e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:51.165457 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-7ae20b39-d6db-492e-8e45-a132615ba917 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:51.169174 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-7ae20b39-d6db-492e-8e45-a132615ba917 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.218646 Jun 07 08:39:51.169945 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 108/206] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:50 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:39:51.212932 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-70856955-bd5d-4ee1-a866-6afba72e103e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.127582 Jun 07 08:39:51.213747 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 99/207] 10.222.0.17 () {58 vars in 1274 bytes} [Tue Jun 7 08:39:51 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:39:51.921470 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-428aa28c-9ba0-4366-88b9-3d73a3bb15d4 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:51.922081 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-428aa28c-9ba0-4366-88b9-3d73a3bb15d4 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: 96c29268-a0e7-41b2-9a4e-145dc92445f1] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:51.987961 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-428aa28c-9ba0-4366-88b9-3d73a3bb15d4 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:51.995731 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-428aa28c-9ba0-4366-88b9-3d73a3bb15d4 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1" status: 200 len: 1214 microversion: 2.1 time: 0.078472 Jun 07 08:39:51.996314 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 109/208] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:51 2022] GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:39:52.191700 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-b9e303a2-f717-4467-9147-71cdcaede1a0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:52.191700 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-b9e303a2-f717-4467-9147-71cdcaede1a0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:52.196939 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b9e303a2-f717-4467-9147-71cdcaede1a0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:52.197412 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b9e303a2-f717-4467-9147-71cdcaede1a0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:52.198229 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b9e303a2-f717-4467-9147-71cdcaede1a0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:52.198667 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b9e303a2-f717-4467-9147-71cdcaede1a0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:52.439649 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-b9e303a2-f717-4467-9147-71cdcaede1a0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:52.449772 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-b9e303a2-f717-4467-9147-71cdcaede1a0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.264148 Jun 07 08:39:52.449772 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 100/209] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:52 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:52.886198 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-642bb181-8df5-466f-a82d-ae207893c4ab req-c8b98b96-ef09-41ad-ab0c-cc564646ad54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7", "tag": "cb22b910-c497-4ee0-831c-3c7b0d2ea236"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:39:52.895776 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-642bb181-8df5-466f-a82d-ae207893c4ab req-c8b98b96-ef09-41ad-ab0c-cc564646ad54 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:52.896837 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-642bb181-8df5-466f-a82d-ae207893c4ab req-c8b98b96-ef09-41ad-ab0c-cc564646ad54 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:52.908852 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-642bb181-8df5-466f-a82d-ae207893c4ab req-c8b98b96-ef09-41ad-ab0c-cc564646ad54 service nova] Creating event network-changed:cb22b910-c497-4ee0-831c-3c7b0d2ea236 for instance 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 on hv-cinder-74014 Jun 07 08:39:52.914822 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-642bb181-8df5-466f-a82d-ae207893c4ab req-c8b98b96-ef09-41ad-ab0c-cc564646ad54 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032172 Jun 07 08:39:52.915524 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 110/210] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:39:53.012339 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-725dd034-7911-462d-9f8e-b6557a834dbb tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:53.012947 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-725dd034-7911-462d-9f8e-b6557a834dbb tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: 96c29268-a0e7-41b2-9a4e-145dc92445f1] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:53.018824 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-725dd034-7911-462d-9f8e-b6557a834dbb tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:53.019268 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-725dd034-7911-462d-9f8e-b6557a834dbb tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:53.020013 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-725dd034-7911-462d-9f8e-b6557a834dbb tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:53.023507 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-725dd034-7911-462d-9f8e-b6557a834dbb tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:53.101828 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-725dd034-7911-462d-9f8e-b6557a834dbb tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:53.109882 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-725dd034-7911-462d-9f8e-b6557a834dbb tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1" status: 200 len: 1266 microversion: 2.1 time: 0.101366 Jun 07 08:39:53.110453 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 101/211] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:53 2022] GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1 => generated 1266 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:53.468657 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-5ee5f4c1-3e42-42fc-b282-b68208b9b765 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:53.469695 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-5ee5f4c1-3e42-42fc-b282-b68208b9b765 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:53.483455 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5ee5f4c1-3e42-42fc-b282-b68208b9b765 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:53.484335 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5ee5f4c1-3e42-42fc-b282-b68208b9b765 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:53.486836 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5ee5f4c1-3e42-42fc-b282-b68208b9b765 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:53.486836 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5ee5f4c1-3e42-42fc-b282-b68208b9b765 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:53.778539 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-5ee5f4c1-3e42-42fc-b282-b68208b9b765 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:53.795880 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-5ee5f4c1-3e42-42fc-b282-b68208b9b765 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.331775 Jun 07 08:39:53.796955 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 111/212] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:53 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:54.131316 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-8892a1e3-2e37-497f-a57c-974cc3169f7a tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:54.139159 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-8892a1e3-2e37-497f-a57c-974cc3169f7a tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: 96c29268-a0e7-41b2-9a4e-145dc92445f1] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:54.152523 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8892a1e3-2e37-497f-a57c-974cc3169f7a tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:54.153083 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8892a1e3-2e37-497f-a57c-974cc3169f7a tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:54.154160 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8892a1e3-2e37-497f-a57c-974cc3169f7a tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:54.154934 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8892a1e3-2e37-497f-a57c-974cc3169f7a tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:54.287452 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-8892a1e3-2e37-497f-a57c-974cc3169f7a tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:54.299204 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-8892a1e3-2e37-497f-a57c-974cc3169f7a tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1" status: 200 len: 1272 microversion: 2.1 time: 0.175330 Jun 07 08:39:54.300208 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 102/213] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:54 2022] GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1 => generated 1272 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:54.816989 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-d62055b7-f546-413b-a216-4af26c438d07 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:54.818030 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-d62055b7-f546-413b-a216-4af26c438d07 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:54.825605 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d62055b7-f546-413b-a216-4af26c438d07 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:54.826049 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d62055b7-f546-413b-a216-4af26c438d07 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:54.826817 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d62055b7-f546-413b-a216-4af26c438d07 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:54.827246 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d62055b7-f546-413b-a216-4af26c438d07 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:55.048221 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-d62055b7-f546-413b-a216-4af26c438d07 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:55.059263 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-d62055b7-f546-413b-a216-4af26c438d07 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.247938 Jun 07 08:39:55.060236 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 112/214] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:54 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:55.323019 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-a5cca942-3466-45a3-9227-b9029d07f06c tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:55.324258 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-a5cca942-3466-45a3-9227-b9029d07f06c tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: 96c29268-a0e7-41b2-9a4e-145dc92445f1] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:55.331239 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a5cca942-3466-45a3-9227-b9029d07f06c tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:55.331821 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a5cca942-3466-45a3-9227-b9029d07f06c tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:55.332820 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a5cca942-3466-45a3-9227-b9029d07f06c tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:55.333869 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a5cca942-3466-45a3-9227-b9029d07f06c tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:55.560058 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-a5cca942-3466-45a3-9227-b9029d07f06c tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:55.569102 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-a5cca942-3466-45a3-9227-b9029d07f06c tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1" status: 200 len: 1314 microversion: 2.1 time: 0.250206 Jun 07 08:39:55.569894 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 103/215] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:55 2022] GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:55.786404 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-35de983b-2221-45d7-a665-d95e14a5f477 req-2e2545fe-2ce7-4a74-8816-3152888d3f7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96c29268-a0e7-41b2-9a4e-145dc92445f1", "tag": "a7405d01-b204-4f45-a2f8-5b34b3d10ffe"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:39:55.795785 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-35de983b-2221-45d7-a665-d95e14a5f477 req-2e2545fe-2ce7-4a74-8816-3152888d3f7d service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:55.796235 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-35de983b-2221-45d7-a665-d95e14a5f477 req-2e2545fe-2ce7-4a74-8816-3152888d3f7d service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:55.812155 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-35de983b-2221-45d7-a665-d95e14a5f477 req-2e2545fe-2ce7-4a74-8816-3152888d3f7d service nova] Creating event network-changed:a7405d01-b204-4f45-a2f8-5b34b3d10ffe for instance 96c29268-a0e7-41b2-9a4e-145dc92445f1 on hv-cinder-74014 Jun 07 08:39:55.812155 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-35de983b-2221-45d7-a665-d95e14a5f477 req-2e2545fe-2ce7-4a74-8816-3152888d3f7d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029756 Jun 07 08:39:55.812630 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 113/216] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:39:56.078334 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-799100d5-27a7-4cfa-be9f-bcb75fba0893 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:56.079212 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-799100d5-27a7-4cfa-be9f-bcb75fba0893 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:56.086957 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-799100d5-27a7-4cfa-be9f-bcb75fba0893 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:56.087649 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-799100d5-27a7-4cfa-be9f-bcb75fba0893 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:56.092929 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-799100d5-27a7-4cfa-be9f-bcb75fba0893 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:56.094295 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-799100d5-27a7-4cfa-be9f-bcb75fba0893 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:56.299461 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-799100d5-27a7-4cfa-be9f-bcb75fba0893 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:56.313969 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-799100d5-27a7-4cfa-be9f-bcb75fba0893 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.239975 Jun 07 08:39:56.322639 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 104/217] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:56 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:56.457475 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-a86eae96-04a9-49fe-8f1e-4033759f53cb tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:56.458059 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-a86eae96-04a9-49fe-8f1e-4033759f53cb tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:56.467343 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a86eae96-04a9-49fe-8f1e-4033759f53cb tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:56.467708 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a86eae96-04a9-49fe-8f1e-4033759f53cb tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:56.468488 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a86eae96-04a9-49fe-8f1e-4033759f53cb tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:56.476922 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a86eae96-04a9-49fe-8f1e-4033759f53cb tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:56.554321 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-a86eae96-04a9-49fe-8f1e-4033759f53cb tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad/ips" status: 200 len: 151 microversion: 2.20 time: 0.101027 Jun 07 08:39:56.554946 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 114/218] 10.222.0.17 () {60 vars in 1288 bytes} [Tue Jun 7 08:39:56 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad/ips => generated 151 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 08:39:56.589106 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-9eff2f2e-423e-4b48-8f02-55877b7a1b59 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:56.589106 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-9eff2f2e-423e-4b48-8f02-55877b7a1b59 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: 96c29268-a0e7-41b2-9a4e-145dc92445f1] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:56.600586 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9eff2f2e-423e-4b48-8f02-55877b7a1b59 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:56.601319 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9eff2f2e-423e-4b48-8f02-55877b7a1b59 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:56.603495 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9eff2f2e-423e-4b48-8f02-55877b7a1b59 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:56.604367 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9eff2f2e-423e-4b48-8f02-55877b7a1b59 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:56.795032 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-9eff2f2e-423e-4b48-8f02-55877b7a1b59 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:56.806892 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-9eff2f2e-423e-4b48-8f02-55877b7a1b59 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1" status: 200 len: 1314 microversion: 2.1 time: 0.223413 Jun 07 08:39:56.807759 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 105/219] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:56 2022] GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:39:57.332437 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-8940cd95-02a8-434d-a51b-e7ca7d82e270 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:57.333245 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-8940cd95-02a8-434d-a51b-e7ca7d82e270 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:57.340606 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8940cd95-02a8-434d-a51b-e7ca7d82e270 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:57.341070 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8940cd95-02a8-434d-a51b-e7ca7d82e270 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:57.341848 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8940cd95-02a8-434d-a51b-e7ca7d82e270 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:57.342286 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8940cd95-02a8-434d-a51b-e7ca7d82e270 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:57.491093 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-8940cd95-02a8-434d-a51b-e7ca7d82e270 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:57.499932 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-8940cd95-02a8-434d-a51b-e7ca7d82e270 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.171952 Jun 07 08:39:57.501301 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 115/220] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:57 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:57.824903 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-f701d8a6-15ab-4484-85b9-89d3b33c85e1 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:57.825765 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-f701d8a6-15ab-4484-85b9-89d3b33c85e1 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: 96c29268-a0e7-41b2-9a4e-145dc92445f1] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:57.832455 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f701d8a6-15ab-4484-85b9-89d3b33c85e1 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:57.832905 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f701d8a6-15ab-4484-85b9-89d3b33c85e1 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:57.833737 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f701d8a6-15ab-4484-85b9-89d3b33c85e1 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:57.834309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f701d8a6-15ab-4484-85b9-89d3b33c85e1 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:57.994284 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-f701d8a6-15ab-4484-85b9-89d3b33c85e1 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:58.002266 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-f701d8a6-15ab-4484-85b9-89d3b33c85e1 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1" status: 200 len: 1314 microversion: 2.1 time: 0.181566 Jun 07 08:39:58.002970 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 106/221] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:57 2022] GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:58.517813 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-8a6753d6-ec92-461d-8661-a3284e9e9949 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:58.518415 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-8a6753d6-ec92-461d-8661-a3284e9e9949 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:58.525196 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8a6753d6-ec92-461d-8661-a3284e9e9949 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:58.525649 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8a6753d6-ec92-461d-8661-a3284e9e9949 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:58.526460 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8a6753d6-ec92-461d-8661-a3284e9e9949 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:58.526890 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8a6753d6-ec92-461d-8661-a3284e9e9949 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:58.689999 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-8a6753d6-ec92-461d-8661-a3284e9e9949 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:58.710317 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-8a6753d6-ec92-461d-8661-a3284e9e9949 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.184280 Jun 07 08:39:58.710317 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 116/222] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:58 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:59.019399 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-670c00f4-3b76-4004-a99c-27e2feffa7be tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:59.020021 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-670c00f4-3b76-4004-a99c-27e2feffa7be tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: 96c29268-a0e7-41b2-9a4e-145dc92445f1] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:59.026301 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-670c00f4-3b76-4004-a99c-27e2feffa7be tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:59.026830 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-670c00f4-3b76-4004-a99c-27e2feffa7be tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:59.033582 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-670c00f4-3b76-4004-a99c-27e2feffa7be tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:59.033582 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-670c00f4-3b76-4004-a99c-27e2feffa7be tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:59.178300 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-670c00f4-3b76-4004-a99c-27e2feffa7be tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:59.187251 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-670c00f4-3b76-4004-a99c-27e2feffa7be tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1" status: 200 len: 1314 microversion: 2.1 time: 0.171318 Jun 07 08:39:59.187700 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 107/223] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:59 2022] GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:59.719318 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-90f156f7-1013-42d0-900e-a978727261f1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:39:59.720735 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-90f156f7-1013-42d0-900e-a978727261f1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:59.728447 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-90f156f7-1013-42d0-900e-a978727261f1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:59.728895 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-90f156f7-1013-42d0-900e-a978727261f1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:59.730358 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-90f156f7-1013-42d0-900e-a978727261f1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:59.730927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-90f156f7-1013-42d0-900e-a978727261f1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:59.882671 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-90f156f7-1013-42d0-900e-a978727261f1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:39:59.891393 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-90f156f7-1013-42d0-900e-a978727261f1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.178946 Jun 07 08:39:59.897087 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 117/224] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:39:59 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:39:59.906835 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-0944b6b8-8909-444b-aa56-ad66c76b78b6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:39:59.907381 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-0944b6b8-8909-444b-aa56-ad66c76b78b6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:39:59.913996 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0944b6b8-8909-444b-aa56-ad66c76b78b6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:59.914452 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0944b6b8-8909-444b-aa56-ad66c76b78b6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:59.915227 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0944b6b8-8909-444b-aa56-ad66c76b78b6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:39:59.915961 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0944b6b8-8909-444b-aa56-ad66c76b78b6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:39:59.957655 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.objects.instance [None req-0944b6b8-8909-444b-aa56-ad66c76b78b6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lazy-loading 'flavor' on Instance uuid 60630f0f-2831-479d-91fc-477b773635ad {{(pid=129726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:40:00.139889 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:40:00.204087 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-fd0a45bd-d339-4f07-8b15-cf1fd21b7a49 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:00.204685 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-fd0a45bd-d339-4f07-8b15-cf1fd21b7a49 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: 96c29268-a0e7-41b2-9a4e-145dc92445f1] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:00.212547 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-fd0a45bd-d339-4f07-8b15-cf1fd21b7a49 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:00.213009 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-fd0a45bd-d339-4f07-8b15-cf1fd21b7a49 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:00.213787 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-fd0a45bd-d339-4f07-8b15-cf1fd21b7a49 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:00.214216 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-fd0a45bd-d339-4f07-8b15-cf1fd21b7a49 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:00.361612 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-fd0a45bd-d339-4f07-8b15-cf1fd21b7a49 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:00.370737 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-fd0a45bd-d339-4f07-8b15-cf1fd21b7a49 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1" status: 200 len: 1314 microversion: 2.1 time: 0.170479 Jun 07 08:40:00.371511 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 118/225] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:00 2022] GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:40:00.717786 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-0944b6b8-8909-444b-aa56-ad66c76b78b6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "POST /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad/action" status: 202 len: 0 microversion: 2.20 time: 0.815024 Jun 07 08:40:00.718513 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 108/226] 10.222.0.17 () {62 vars in 1318 bytes} [Tue Jun 7 08:39:59 2022] POST /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad/action => generated 0 bytes in 818 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 08:40:00.727460 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-c4493e12-12b0-44b5-81e9-a3a6e6711bb8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:00.728023 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-c4493e12-12b0-44b5-81e9-a3a6e6711bb8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:00.730038 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell0:SELECT=2 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:40:00.736213 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c4493e12-12b0-44b5-81e9-a3a6e6711bb8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:00.736925 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c4493e12-12b0-44b5-81e9-a3a6e6711bb8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:00.737956 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c4493e12-12b0-44b5-81e9-a3a6e6711bb8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:00.738732 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c4493e12-12b0-44b5-81e9-a3a6e6711bb8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:00.893312 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-c4493e12-12b0-44b5-81e9-a3a6e6711bb8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:00.902970 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-c4493e12-12b0-44b5-81e9-a3a6e6711bb8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:00.905316 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-c4493e12-12b0-44b5-81e9-a3a6e6711bb8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:00.907139 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-c4493e12-12b0-44b5-81e9-a3a6e6711bb8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1724 microversion: 2.20 time: 0.183744 Jun 07 08:40:00.917143 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-afaf7395-fcb3-4c96-828b-746787b2ad3b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:00.918675 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-afaf7395-fcb3-4c96-828b-746787b2ad3b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:00.926743 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 119/227] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:00 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:40:00.927683 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-afaf7395-fcb3-4c96-828b-746787b2ad3b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:00.928209 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-afaf7395-fcb3-4c96-828b-746787b2ad3b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:00.930117 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-afaf7395-fcb3-4c96-828b-746787b2ad3b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:00.930800 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-afaf7395-fcb3-4c96-828b-746787b2ad3b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:01.073825 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-afaf7395-fcb3-4c96-828b-746787b2ad3b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:01.082254 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-afaf7395-fcb3-4c96-828b-746787b2ad3b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.172791 Jun 07 08:40:01.082838 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 109/228] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:00 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:40:01.388828 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-e7019c98-e30e-4f5a-862d-abe298e202b7 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:01.389784 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-e7019c98-e30e-4f5a-862d-abe298e202b7 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: 96c29268-a0e7-41b2-9a4e-145dc92445f1] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:01.401896 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e7019c98-e30e-4f5a-862d-abe298e202b7 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:01.402348 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e7019c98-e30e-4f5a-862d-abe298e202b7 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:01.403312 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e7019c98-e30e-4f5a-862d-abe298e202b7 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:01.403760 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e7019c98-e30e-4f5a-862d-abe298e202b7 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:01.422777 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-7571fce3-ddce-435f-b0c8-cead33eecceb req-b42f8c10-7e2d-43c4-bf27-c80317b64ddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96c29268-a0e7-41b2-9a4e-145dc92445f1", "name": "network-vif-plugged", "status": "completed", "tag": "a7405d01-b204-4f45-a2f8-5b34b3d10ffe"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:40:01.431507 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-7571fce3-ddce-435f-b0c8-cead33eecceb req-b42f8c10-7e2d-43c4-bf27-c80317b64ddf service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:01.432008 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-7571fce3-ddce-435f-b0c8-cead33eecceb req-b42f8c10-7e2d-43c4-bf27-c80317b64ddf service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:01.444650 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-7571fce3-ddce-435f-b0c8-cead33eecceb req-b42f8c10-7e2d-43c4-bf27-c80317b64ddf service nova] Creating event network-vif-plugged:a7405d01-b204-4f45-a2f8-5b34b3d10ffe for instance 96c29268-a0e7-41b2-9a4e-145dc92445f1 on hv-cinder-74014 Jun 07 08:40:01.452105 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-7571fce3-ddce-435f-b0c8-cead33eecceb req-b42f8c10-7e2d-43c4-bf27-c80317b64ddf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031209 Jun 07 08:40:01.452105 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 110/229] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:40:01.605384 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-e7019c98-e30e-4f5a-862d-abe298e202b7 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:01.617127 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-e7019c98-e30e-4f5a-862d-abe298e202b7 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1" status: 200 len: 1314 microversion: 2.1 time: 0.233036 Jun 07 08:40:01.617786 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 120/230] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:01 2022] GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:01.928704 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-a3c4c0de-02c4-4110-a47f-625bf09d241a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:01.929880 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-a3c4c0de-02c4-4110-a47f-625bf09d241a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:01.938884 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a3c4c0de-02c4-4110-a47f-625bf09d241a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:01.939832 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a3c4c0de-02c4-4110-a47f-625bf09d241a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:01.941015 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a3c4c0de-02c4-4110-a47f-625bf09d241a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:01.941979 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a3c4c0de-02c4-4110-a47f-625bf09d241a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:02.089100 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-a3c4c0de-02c4-4110-a47f-625bf09d241a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:02.097970 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-a3c4c0de-02c4-4110-a47f-625bf09d241a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:02.100034 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-b95106bd-5d18-4c01-b3d5-cff422174d67 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:02.103596 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-a3c4c0de-02c4-4110-a47f-625bf09d241a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:02.103763 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-b95106bd-5d18-4c01-b3d5-cff422174d67 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:02.103862 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-a3c4c0de-02c4-4110-a47f-625bf09d241a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1724 microversion: 2.20 time: 0.179103 Jun 07 08:40:02.103862 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 111/231] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:01 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:40:02.104022 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell0:SELECT=10 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:40:02.115680 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b95106bd-5d18-4c01-b3d5-cff422174d67 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:02.116130 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b95106bd-5d18-4c01-b3d5-cff422174d67 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:02.116910 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b95106bd-5d18-4c01-b3d5-cff422174d67 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:02.117394 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b95106bd-5d18-4c01-b3d5-cff422174d67 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:02.250971 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-b95106bd-5d18-4c01-b3d5-cff422174d67 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:02.259399 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-b95106bd-5d18-4c01-b3d5-cff422174d67 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.163890 Jun 07 08:40:02.260063 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 121/232] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:02 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:40:02.634326 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-f5a34689-c300-4b16-bdc0-df2c6fff03b5 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:02.634947 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-f5a34689-c300-4b16-bdc0-df2c6fff03b5 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: 96c29268-a0e7-41b2-9a4e-145dc92445f1] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:02.640980 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f5a34689-c300-4b16-bdc0-df2c6fff03b5 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:02.641462 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f5a34689-c300-4b16-bdc0-df2c6fff03b5 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:02.642230 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f5a34689-c300-4b16-bdc0-df2c6fff03b5 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:02.642666 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f5a34689-c300-4b16-bdc0-df2c6fff03b5 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:02.775561 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-f5a34689-c300-4b16-bdc0-df2c6fff03b5 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:02.783580 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-f5a34689-c300-4b16-bdc0-df2c6fff03b5 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1" status: 200 len: 1314 microversion: 2.1 time: 0.153237 Jun 07 08:40:02.784186 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 112/233] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:02 2022] GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:03.121065 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-a4478b80-e035-44de-a1ea-64030c868d23 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:03.121680 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-a4478b80-e035-44de-a1ea-64030c868d23 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:03.128527 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a4478b80-e035-44de-a1ea-64030c868d23 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:03.128979 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a4478b80-e035-44de-a1ea-64030c868d23 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:03.129770 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a4478b80-e035-44de-a1ea-64030c868d23 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:03.130206 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a4478b80-e035-44de-a1ea-64030c868d23 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:03.268541 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-a4478b80-e035-44de-a1ea-64030c868d23 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:03.278781 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-a4478b80-e035-44de-a1ea-64030c868d23 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:03.280287 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-a4478b80-e035-44de-a1ea-64030c868d23 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:03.281265 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-035416a4-57ad-4cdf-842b-7d9365f30325 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:03.281505 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-a4478b80-e035-44de-a1ea-64030c868d23 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1724 microversion: 2.20 time: 0.164882 Jun 07 08:40:03.281881 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-035416a4-57ad-4cdf-842b-7d9365f30325 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:03.282068 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 122/234] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:03 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:40:03.289459 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-035416a4-57ad-4cdf-842b-7d9365f30325 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:03.289911 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-035416a4-57ad-4cdf-842b-7d9365f30325 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:03.290685 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-035416a4-57ad-4cdf-842b-7d9365f30325 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:03.291122 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-035416a4-57ad-4cdf-842b-7d9365f30325 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:03.429669 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-035416a4-57ad-4cdf-842b-7d9365f30325 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:03.439216 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-035416a4-57ad-4cdf-842b-7d9365f30325 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.161510 Jun 07 08:40:03.439986 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 113/235] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:03 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:40:03.800563 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-ccee32f7-1d9c-419d-a65b-f2b008e3ec6c tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:03.801209 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-ccee32f7-1d9c-419d-a65b-f2b008e3ec6c tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: 96c29268-a0e7-41b2-9a4e-145dc92445f1] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:03.807574 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ccee32f7-1d9c-419d-a65b-f2b008e3ec6c tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:03.808027 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ccee32f7-1d9c-419d-a65b-f2b008e3ec6c tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:03.808807 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ccee32f7-1d9c-419d-a65b-f2b008e3ec6c tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:03.809278 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ccee32f7-1d9c-419d-a65b-f2b008e3ec6c tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:03.946361 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-ccee32f7-1d9c-419d-a65b-f2b008e3ec6c tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:03.962536 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-ccee32f7-1d9c-419d-a65b-f2b008e3ec6c tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1" status: 200 len: 1314 microversion: 2.1 time: 0.165681 Jun 07 08:40:03.963412 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 123/236] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:03 2022] GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:04.300501 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-fe5b61a1-3d6d-425b-a87d-10ad09128c4c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:04.301163 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-fe5b61a1-3d6d-425b-a87d-10ad09128c4c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:04.311450 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fe5b61a1-3d6d-425b-a87d-10ad09128c4c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:04.311953 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fe5b61a1-3d6d-425b-a87d-10ad09128c4c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:04.312719 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fe5b61a1-3d6d-425b-a87d-10ad09128c4c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:04.313205 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fe5b61a1-3d6d-425b-a87d-10ad09128c4c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:04.450984 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-fe5b61a1-3d6d-425b-a87d-10ad09128c4c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:04.456647 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-779cf4e0-ce41-4b5a-ad9a-b252f92c2c91 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:04.457288 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-779cf4e0-ce41-4b5a-ad9a-b252f92c2c91 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:04.459993 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-fe5b61a1-3d6d-425b-a87d-10ad09128c4c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:04.461529 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-fe5b61a1-3d6d-425b-a87d-10ad09128c4c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:04.462697 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-fe5b61a1-3d6d-425b-a87d-10ad09128c4c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1724 microversion: 2.20 time: 0.166288 Jun 07 08:40:04.463268 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 114/237] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:04 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:40:04.464439 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-779cf4e0-ce41-4b5a-ad9a-b252f92c2c91 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:04.464884 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-779cf4e0-ce41-4b5a-ad9a-b252f92c2c91 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:04.465705 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-779cf4e0-ce41-4b5a-ad9a-b252f92c2c91 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:04.466137 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-779cf4e0-ce41-4b5a-ad9a-b252f92c2c91 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:04.602005 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-779cf4e0-ce41-4b5a-ad9a-b252f92c2c91 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:04.609656 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-779cf4e0-ce41-4b5a-ad9a-b252f92c2c91 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.156737 Jun 07 08:40:04.610377 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 124/238] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:04 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:40:04.980550 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-ba84b948-68f5-43da-bd04-df70f5f7163e tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:04.981107 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-ba84b948-68f5-43da-bd04-df70f5f7163e tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: 96c29268-a0e7-41b2-9a4e-145dc92445f1] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:04.987220 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ba84b948-68f5-43da-bd04-df70f5f7163e tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:04.987667 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ba84b948-68f5-43da-bd04-df70f5f7163e tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:04.988813 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ba84b948-68f5-43da-bd04-df70f5f7163e tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:04.989272 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ba84b948-68f5-43da-bd04-df70f5f7163e tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:05.127853 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-ba84b948-68f5-43da-bd04-df70f5f7163e tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:05.135488 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-ba84b948-68f5-43da-bd04-df70f5f7163e tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1" status: 200 len: 1314 microversion: 2.1 time: 0.159091 Jun 07 08:40:05.136071 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 115/239] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:04 2022] GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:05.481079 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-eda397c8-fd93-4cbc-8455-2d46ca40d9f6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:05.481679 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-eda397c8-fd93-4cbc-8455-2d46ca40d9f6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:05.488270 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-eda397c8-fd93-4cbc-8455-2d46ca40d9f6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:05.488712 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-eda397c8-fd93-4cbc-8455-2d46ca40d9f6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:05.489534 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-eda397c8-fd93-4cbc-8455-2d46ca40d9f6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:05.490507 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-eda397c8-fd93-4cbc-8455-2d46ca40d9f6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:05.627926 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-d12c03f9-cbff-4332-b94e-f825ab5c6163 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:05.628563 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-eda397c8-fd93-4cbc-8455-2d46ca40d9f6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:05.628677 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-d12c03f9-cbff-4332-b94e-f825ab5c6163 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:05.635673 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d12c03f9-cbff-4332-b94e-f825ab5c6163 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:05.636147 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d12c03f9-cbff-4332-b94e-f825ab5c6163 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:05.636947 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d12c03f9-cbff-4332-b94e-f825ab5c6163 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:05.637406 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d12c03f9-cbff-4332-b94e-f825ab5c6163 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:05.637511 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-eda397c8-fd93-4cbc-8455-2d46ca40d9f6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:05.638939 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-eda397c8-fd93-4cbc-8455-2d46ca40d9f6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:05.640116 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-eda397c8-fd93-4cbc-8455-2d46ca40d9f6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1724 microversion: 2.20 time: 0.162925 Jun 07 08:40:05.640697 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 125/240] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:05 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:40:05.775443 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-d12c03f9-cbff-4332-b94e-f825ab5c6163 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:05.783485 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-d12c03f9-cbff-4332-b94e-f825ab5c6163 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.160068 Jun 07 08:40:05.784370 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 116/241] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:05 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:06.152853 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-580d31c7-1150-4f76-98ce-d33f46fa7f4b tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:06.153510 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-580d31c7-1150-4f76-98ce-d33f46fa7f4b tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: 96c29268-a0e7-41b2-9a4e-145dc92445f1] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:06.159902 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-580d31c7-1150-4f76-98ce-d33f46fa7f4b tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:06.160343 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-580d31c7-1150-4f76-98ce-d33f46fa7f4b tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:06.161153 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-580d31c7-1150-4f76-98ce-d33f46fa7f4b tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:06.161611 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-580d31c7-1150-4f76-98ce-d33f46fa7f4b tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:06.166088 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=100 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:40:06.433121 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-580d31c7-1150-4f76-98ce-d33f46fa7f4b tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:06.440925 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-580d31c7-1150-4f76-98ce-d33f46fa7f4b tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1" status: 200 len: 1314 microversion: 2.1 time: 0.292449 Jun 07 08:40:06.441631 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 126/242] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:06 2022] GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:06.660966 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-d47b4e4e-bf07-4d14-a5b7-312ed6ffe49c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:06.661535 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-d47b4e4e-bf07-4d14-a5b7-312ed6ffe49c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:06.667926 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d47b4e4e-bf07-4d14-a5b7-312ed6ffe49c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:06.668371 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d47b4e4e-bf07-4d14-a5b7-312ed6ffe49c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:06.669212 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d47b4e4e-bf07-4d14-a5b7-312ed6ffe49c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:06.669645 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d47b4e4e-bf07-4d14-a5b7-312ed6ffe49c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:06.802006 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-c62a20a4-dcb7-4a4b-8778-dbce8c89e806 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:06.802678 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-c62a20a4-dcb7-4a4b-8778-dbce8c89e806 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:06.812962 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c62a20a4-dcb7-4a4b-8778-dbce8c89e806 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:06.814387 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c62a20a4-dcb7-4a4b-8778-dbce8c89e806 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:06.814746 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c62a20a4-dcb7-4a4b-8778-dbce8c89e806 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:06.815339 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c62a20a4-dcb7-4a4b-8778-dbce8c89e806 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:06.821148 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-d47b4e4e-bf07-4d14-a5b7-312ed6ffe49c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:06.839776 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-d47b4e4e-bf07-4d14-a5b7-312ed6ffe49c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:06.848750 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-d47b4e4e-bf07-4d14-a5b7-312ed6ffe49c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:06.850920 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-d47b4e4e-bf07-4d14-a5b7-312ed6ffe49c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1724 microversion: 2.20 time: 0.194128 Jun 07 08:40:06.853998 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 117/243] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:06 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:40:06.964584 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-c62a20a4-dcb7-4a4b-8778-dbce8c89e806 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:06.972330 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-c62a20a4-dcb7-4a4b-8778-dbce8c89e806 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.174790 Jun 07 08:40:06.972918 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 127/244] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:06 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:40:07.458710 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-50b117a9-4bc6-4d84-8f3e-c30685794b93 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:07.459288 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-50b117a9-4bc6-4d84-8f3e-c30685794b93 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: 96c29268-a0e7-41b2-9a4e-145dc92445f1] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:07.465832 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-50b117a9-4bc6-4d84-8f3e-c30685794b93 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:07.466275 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-50b117a9-4bc6-4d84-8f3e-c30685794b93 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:07.467039 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-50b117a9-4bc6-4d84-8f3e-c30685794b93 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:07.467461 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-50b117a9-4bc6-4d84-8f3e-c30685794b93 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:07.611858 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-50b117a9-4bc6-4d84-8f3e-c30685794b93 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:07.622070 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-50b117a9-4bc6-4d84-8f3e-c30685794b93 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1" status: 200 len: 1498 microversion: 2.1 time: 0.167217 Jun 07 08:40:07.623105 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 118/245] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:07 2022] GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1 => generated 1498 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:40:07.871933 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-8f53cd90-c4b4-4ce5-bd82-910c4f4e187c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:07.872632 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-8f53cd90-c4b4-4ce5-bd82-910c4f4e187c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:07.879320 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8f53cd90-c4b4-4ce5-bd82-910c4f4e187c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:07.884333 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8f53cd90-c4b4-4ce5-bd82-910c4f4e187c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:07.884333 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8f53cd90-c4b4-4ce5-bd82-910c4f4e187c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:07.884333 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8f53cd90-c4b4-4ce5-bd82-910c4f4e187c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:07.989044 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-2d709125-e885-4f95-bebf-287d136e320b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:07.991215 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-2d709125-e885-4f95-bebf-287d136e320b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:07.997287 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2d709125-e885-4f95-bebf-287d136e320b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:07.997742 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2d709125-e885-4f95-bebf-287d136e320b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:07.998702 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2d709125-e885-4f95-bebf-287d136e320b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:08.006194 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2d709125-e885-4f95-bebf-287d136e320b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:08.036068 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-8f53cd90-c4b4-4ce5-bd82-910c4f4e187c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:08.044634 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-8f53cd90-c4b4-4ce5-bd82-910c4f4e187c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:08.046219 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-8f53cd90-c4b4-4ce5-bd82-910c4f4e187c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:08.047611 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-8f53cd90-c4b4-4ce5-bd82-910c4f4e187c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1724 microversion: 2.20 time: 0.179812 Jun 07 08:40:08.048155 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 128/246] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:07 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:40:08.147301 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-2d709125-e885-4f95-bebf-287d136e320b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:08.155510 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-2d709125-e885-4f95-bebf-287d136e320b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.169657 Jun 07 08:40:08.155510 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 119/247] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:07 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:09.067000 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-4110a1a9-359a-4c2a-aa0a-fa2b77cf3dc5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:09.067678 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-4110a1a9-359a-4c2a-aa0a-fa2b77cf3dc5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:09.074571 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4110a1a9-359a-4c2a-aa0a-fa2b77cf3dc5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:09.075017 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4110a1a9-359a-4c2a-aa0a-fa2b77cf3dc5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:09.075791 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4110a1a9-359a-4c2a-aa0a-fa2b77cf3dc5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:09.076219 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4110a1a9-359a-4c2a-aa0a-fa2b77cf3dc5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:09.173112 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-2eaa4b14-4d59-417f-887b-654f50b7de76 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:09.173729 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-2eaa4b14-4d59-417f-887b-654f50b7de76 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:09.180264 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2eaa4b14-4d59-417f-887b-654f50b7de76 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:09.180705 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2eaa4b14-4d59-417f-887b-654f50b7de76 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:09.181575 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2eaa4b14-4d59-417f-887b-654f50b7de76 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:09.182007 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2eaa4b14-4d59-417f-887b-654f50b7de76 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:09.212960 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-4110a1a9-359a-4c2a-aa0a-fa2b77cf3dc5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:09.221445 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-4110a1a9-359a-4c2a-aa0a-fa2b77cf3dc5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:09.222946 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-4110a1a9-359a-4c2a-aa0a-fa2b77cf3dc5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:09.224114 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-4110a1a9-359a-4c2a-aa0a-fa2b77cf3dc5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1724 microversion: 2.20 time: 0.161028 Jun 07 08:40:09.224668 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 129/248] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:09 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:40:09.313618 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-2eaa4b14-4d59-417f-887b-654f50b7de76 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:09.322171 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-2eaa4b14-4d59-417f-887b-654f50b7de76 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.153082 Jun 07 08:40:09.322739 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 120/249] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:09 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:40:10.242954 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-db03f32d-ce9e-4eed-af96-cc12f3e2a1ec tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:10.243572 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-db03f32d-ce9e-4eed-af96-cc12f3e2a1ec tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:10.250200 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-db03f32d-ce9e-4eed-af96-cc12f3e2a1ec tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:10.250648 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-db03f32d-ce9e-4eed-af96-cc12f3e2a1ec tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:10.251416 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-db03f32d-ce9e-4eed-af96-cc12f3e2a1ec tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:10.251846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-db03f32d-ce9e-4eed-af96-cc12f3e2a1ec tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:10.339478 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-c395507c-871e-4cbd-b19a-d12da3f0f735 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:10.340082 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-c395507c-871e-4cbd-b19a-d12da3f0f735 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:10.346573 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c395507c-871e-4cbd-b19a-d12da3f0f735 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:10.347021 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c395507c-871e-4cbd-b19a-d12da3f0f735 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:10.347777 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c395507c-871e-4cbd-b19a-d12da3f0f735 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:10.348206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c395507c-871e-4cbd-b19a-d12da3f0f735 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:10.497517 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-c395507c-871e-4cbd-b19a-d12da3f0f735 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:10.506204 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-c395507c-871e-4cbd-b19a-d12da3f0f735 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.169861 Jun 07 08:40:10.507055 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 121/250] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:10 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:40:10.623686 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-db03f32d-ce9e-4eed-af96-cc12f3e2a1ec tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:10.632517 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-db03f32d-ce9e-4eed-af96-cc12f3e2a1ec tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:10.634071 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-db03f32d-ce9e-4eed-af96-cc12f3e2a1ec tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:10.635236 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-db03f32d-ce9e-4eed-af96-cc12f3e2a1ec tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1724 microversion: 2.20 time: 0.396707 Jun 07 08:40:10.635803 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 130/251] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:10 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1724 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:40:11.523826 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-541f2f5a-7569-4511-811d-f5318af07a98 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:11.524434 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-541f2f5a-7569-4511-811d-f5318af07a98 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:11.530966 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-541f2f5a-7569-4511-811d-f5318af07a98 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:11.531411 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-541f2f5a-7569-4511-811d-f5318af07a98 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:11.532173 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-541f2f5a-7569-4511-811d-f5318af07a98 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:11.532609 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-541f2f5a-7569-4511-811d-f5318af07a98 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:11.653673 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-7186d47e-60f9-4a7b-a4a8-f91e490d0c3f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:11.654513 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-7186d47e-60f9-4a7b-a4a8-f91e490d0c3f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:11.662366 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7186d47e-60f9-4a7b-a4a8-f91e490d0c3f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:11.662821 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7186d47e-60f9-4a7b-a4a8-f91e490d0c3f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:11.663606 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7186d47e-60f9-4a7b-a4a8-f91e490d0c3f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:11.664038 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7186d47e-60f9-4a7b-a4a8-f91e490d0c3f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:11.684649 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-541f2f5a-7569-4511-811d-f5318af07a98 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:11.693864 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-541f2f5a-7569-4511-811d-f5318af07a98 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.173765 Jun 07 08:40:11.694473 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 122/252] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:11 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:11.818134 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-7186d47e-60f9-4a7b-a4a8-f91e490d0c3f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:11.826858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-7186d47e-60f9-4a7b-a4a8-f91e490d0c3f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:11.828373 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-7186d47e-60f9-4a7b-a4a8-f91e490d0c3f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:11.830428 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-7186d47e-60f9-4a7b-a4a8-f91e490d0c3f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1724 microversion: 2.20 time: 0.180641 Jun 07 08:40:11.831435 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 131/253] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:11 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:40:12.711799 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-b29b9968-69f6-4828-aca4-085fbd0502f5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:12.712468 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-b29b9968-69f6-4828-aca4-085fbd0502f5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:12.718762 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b29b9968-69f6-4828-aca4-085fbd0502f5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:12.719222 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b29b9968-69f6-4828-aca4-085fbd0502f5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:12.720006 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b29b9968-69f6-4828-aca4-085fbd0502f5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:12.720442 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b29b9968-69f6-4828-aca4-085fbd0502f5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:12.850656 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-fb6181fe-cabb-4b21-8c6c-38384cba60c2 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:12.851504 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-fb6181fe-cabb-4b21-8c6c-38384cba60c2 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:12.858286 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-fb6181fe-cabb-4b21-8c6c-38384cba60c2 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:12.858852 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-fb6181fe-cabb-4b21-8c6c-38384cba60c2 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:12.859735 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-fb6181fe-cabb-4b21-8c6c-38384cba60c2 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:12.860671 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-fb6181fe-cabb-4b21-8c6c-38384cba60c2 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:12.862919 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-b29b9968-69f6-4828-aca4-085fbd0502f5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:12.870860 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-b29b9968-69f6-4828-aca4-085fbd0502f5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.163108 Jun 07 08:40:12.871444 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 123/254] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:12 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:12.997448 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-fb6181fe-cabb-4b21-8c6c-38384cba60c2 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:13.006022 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-fb6181fe-cabb-4b21-8c6c-38384cba60c2 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:13.007525 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-fb6181fe-cabb-4b21-8c6c-38384cba60c2 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:13.008674 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-fb6181fe-cabb-4b21-8c6c-38384cba60c2 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1724 microversion: 2.20 time: 0.162573 Jun 07 08:40:13.009262 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 132/255] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:12 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:40:13.890165 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-c6ed2cbb-ab3f-42fc-9dfb-1905a72b8e2a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:13.891157 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-c6ed2cbb-ab3f-42fc-9dfb-1905a72b8e2a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:13.900592 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c6ed2cbb-ab3f-42fc-9dfb-1905a72b8e2a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:13.901370 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c6ed2cbb-ab3f-42fc-9dfb-1905a72b8e2a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:13.902580 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c6ed2cbb-ab3f-42fc-9dfb-1905a72b8e2a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:13.903312 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c6ed2cbb-ab3f-42fc-9dfb-1905a72b8e2a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:14.027708 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-793a4a45-a2df-4825-9d85-b258fd485cd8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:14.028882 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-793a4a45-a2df-4825-9d85-b258fd485cd8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:14.037051 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-793a4a45-a2df-4825-9d85-b258fd485cd8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:14.037626 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-793a4a45-a2df-4825-9d85-b258fd485cd8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:14.038503 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-793a4a45-a2df-4825-9d85-b258fd485cd8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:14.038979 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-793a4a45-a2df-4825-9d85-b258fd485cd8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:14.054534 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-c6ed2cbb-ab3f-42fc-9dfb-1905a72b8e2a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:14.062561 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-c6ed2cbb-ab3f-42fc-9dfb-1905a72b8e2a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.178099 Jun 07 08:40:14.063120 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 124/256] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:13 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:14.174194 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-793a4a45-a2df-4825-9d85-b258fd485cd8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:14.183661 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-793a4a45-a2df-4825-9d85-b258fd485cd8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:14.185216 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-793a4a45-a2df-4825-9d85-b258fd485cd8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:14.186395 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-793a4a45-a2df-4825-9d85-b258fd485cd8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1724 microversion: 2.20 time: 0.162846 Jun 07 08:40:14.186967 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 133/257] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:14 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:40:14.676038 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-79b52701-f6bb-45c0-8419-3a87ca972243 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:14.676547 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-79b52701-f6bb-45c0-8419-3a87ca972243 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: 96c29268-a0e7-41b2-9a4e-145dc92445f1] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:14.680409 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_api:SELECT=70 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:40:14.684165 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-79b52701-f6bb-45c0-8419-3a87ca972243 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:14.690053 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-79b52701-f6bb-45c0-8419-3a87ca972243 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:14.690053 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-79b52701-f6bb-45c0-8419-3a87ca972243 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:14.690053 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-79b52701-f6bb-45c0-8419-3a87ca972243 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:14.690053 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:40:14.710931 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-79b52701-f6bb-45c0-8419-3a87ca972243 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: 96c29268-a0e7-41b2-9a4e-145dc92445f1] Going to try to terminate instance {{(pid=129726) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 08:40:14.996611 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-79b52701-f6bb-45c0-8419-3a87ca972243 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "DELETE /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1" status: 204 len: 0 microversion: 2.1 time: 0.324229 Jun 07 08:40:14.997543 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 125/258] 10.222.0.17 () {58 vars in 1238 bytes} [Tue Jun 7 08:40:14 2022] DELETE /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 08:40:15.010326 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-5a8d7c4f-3398-45f4-8a5c-c292836798ba tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:15.010996 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-5a8d7c4f-3398-45f4-8a5c-c292836798ba tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: 96c29268-a0e7-41b2-9a4e-145dc92445f1] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:15.017287 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5a8d7c4f-3398-45f4-8a5c-c292836798ba tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:15.017750 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5a8d7c4f-3398-45f4-8a5c-c292836798ba tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:15.018497 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5a8d7c4f-3398-45f4-8a5c-c292836798ba tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:15.018932 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5a8d7c4f-3398-45f4-8a5c-c292836798ba tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:15.080884 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-72ff02ae-820e-4f40-af45-f4ff3d46131d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:15.081803 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-72ff02ae-820e-4f40-af45-f4ff3d46131d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:15.088191 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-72ff02ae-820e-4f40-af45-f4ff3d46131d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:15.088652 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-72ff02ae-820e-4f40-af45-f4ff3d46131d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:15.089474 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-72ff02ae-820e-4f40-af45-f4ff3d46131d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:15.089913 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-72ff02ae-820e-4f40-af45-f4ff3d46131d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:15.160872 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-5a8d7c4f-3398-45f4-8a5c-c292836798ba tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:15.170593 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-5a8d7c4f-3398-45f4-8a5c-c292836798ba tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1" status: 200 len: 1504 microversion: 2.1 time: 0.168745 Jun 07 08:40:15.172451 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 134/259] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:15 2022] GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:15.205322 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-e028ac5c-a6c2-4e74-b2a7-90e99dd0cee8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:15.205930 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-e028ac5c-a6c2-4e74-b2a7-90e99dd0cee8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:15.212881 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e028ac5c-a6c2-4e74-b2a7-90e99dd0cee8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:15.213362 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e028ac5c-a6c2-4e74-b2a7-90e99dd0cee8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:15.214153 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e028ac5c-a6c2-4e74-b2a7-90e99dd0cee8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:15.214568 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e028ac5c-a6c2-4e74-b2a7-90e99dd0cee8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:15.230883 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-72ff02ae-820e-4f40-af45-f4ff3d46131d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:15.238639 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-72ff02ae-820e-4f40-af45-f4ff3d46131d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.162097 Jun 07 08:40:15.239222 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 126/260] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:15 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:40:15.351546 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-e028ac5c-a6c2-4e74-b2a7-90e99dd0cee8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:15.359917 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-e028ac5c-a6c2-4e74-b2a7-90e99dd0cee8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:15.361467 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-e028ac5c-a6c2-4e74-b2a7-90e99dd0cee8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:15.362634 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-e028ac5c-a6c2-4e74-b2a7-90e99dd0cee8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1724 microversion: 2.20 time: 0.161333 Jun 07 08:40:15.363198 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 135/261] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:15 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:40:16.188016 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-f72b97df-d1ed-4d19-a8f4-91614ca96e34 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:16.188639 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-f72b97df-d1ed-4d19-a8f4-91614ca96e34 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: 96c29268-a0e7-41b2-9a4e-145dc92445f1] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:16.196638 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f72b97df-d1ed-4d19-a8f4-91614ca96e34 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:16.196638 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f72b97df-d1ed-4d19-a8f4-91614ca96e34 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:16.196960 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f72b97df-d1ed-4d19-a8f4-91614ca96e34 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:16.197391 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f72b97df-d1ed-4d19-a8f4-91614ca96e34 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:16.256509 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-006b0b5c-b82f-4860-82f6-0cf8ecfd28b0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:16.257152 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-006b0b5c-b82f-4860-82f6-0cf8ecfd28b0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:16.264168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-006b0b5c-b82f-4860-82f6-0cf8ecfd28b0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:16.264610 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-006b0b5c-b82f-4860-82f6-0cf8ecfd28b0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:16.265414 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-006b0b5c-b82f-4860-82f6-0cf8ecfd28b0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:16.265845 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-006b0b5c-b82f-4860-82f6-0cf8ecfd28b0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:16.347460 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-f72b97df-d1ed-4d19-a8f4-91614ca96e34 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:16.363445 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-f72b97df-d1ed-4d19-a8f4-91614ca96e34 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1" status: 200 len: 1504 microversion: 2.1 time: 0.178920 Jun 07 08:40:16.363841 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 127/262] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:16 2022] GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1 => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:16.384690 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-38eaa5ed-3295-4090-ac53-89fdae3ea188 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:16.384690 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-38eaa5ed-3295-4090-ac53-89fdae3ea188 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:16.391928 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-38eaa5ed-3295-4090-ac53-89fdae3ea188 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:16.392891 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-38eaa5ed-3295-4090-ac53-89fdae3ea188 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:16.394513 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-38eaa5ed-3295-4090-ac53-89fdae3ea188 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:16.396090 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-38eaa5ed-3295-4090-ac53-89fdae3ea188 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:16.440028 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-006b0b5c-b82f-4860-82f6-0cf8ecfd28b0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:16.448062 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-006b0b5c-b82f-4860-82f6-0cf8ecfd28b0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.196246 Jun 07 08:40:16.448641 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 136/263] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:16 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:40:16.541028 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-38eaa5ed-3295-4090-ac53-89fdae3ea188 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:16.554015 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-38eaa5ed-3295-4090-ac53-89fdae3ea188 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:16.555535 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-38eaa5ed-3295-4090-ac53-89fdae3ea188 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:16.556753 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-38eaa5ed-3295-4090-ac53-89fdae3ea188 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1724 microversion: 2.20 time: 0.177812 Jun 07 08:40:16.557389 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 128/264] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:16 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:40:17.383264 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-f61100ad-e346-4459-9ce8-1fd6d1437d7e tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:17.383877 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-f61100ad-e346-4459-9ce8-1fd6d1437d7e tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: 96c29268-a0e7-41b2-9a4e-145dc92445f1] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:17.390431 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f61100ad-e346-4459-9ce8-1fd6d1437d7e tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:17.390877 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f61100ad-e346-4459-9ce8-1fd6d1437d7e tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:17.391640 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f61100ad-e346-4459-9ce8-1fd6d1437d7e tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:17.392073 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f61100ad-e346-4459-9ce8-1fd6d1437d7e tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:17.467029 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-a40d796a-b794-4b10-9ff0-eb35baea7b53 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:17.467821 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-a40d796a-b794-4b10-9ff0-eb35baea7b53 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:17.474405 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a40d796a-b794-4b10-9ff0-eb35baea7b53 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:17.474927 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a40d796a-b794-4b10-9ff0-eb35baea7b53 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:17.475757 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a40d796a-b794-4b10-9ff0-eb35baea7b53 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:17.476688 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a40d796a-b794-4b10-9ff0-eb35baea7b53 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:17.530363 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-f61100ad-e346-4459-9ce8-1fd6d1437d7e tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:17.539731 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-f61100ad-e346-4459-9ce8-1fd6d1437d7e tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1" status: 200 len: 1504 microversion: 2.1 time: 0.160619 Jun 07 08:40:17.540509 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 137/265] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:17 2022] GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:17.576653 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-3c337461-9cde-40d6-8f16-7d8175c38827 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:17.577295 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-3c337461-9cde-40d6-8f16-7d8175c38827 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:17.583425 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3c337461-9cde-40d6-8f16-7d8175c38827 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:17.583981 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3c337461-9cde-40d6-8f16-7d8175c38827 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:17.584746 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3c337461-9cde-40d6-8f16-7d8175c38827 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:17.585219 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3c337461-9cde-40d6-8f16-7d8175c38827 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:17.613562 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-a40d796a-b794-4b10-9ff0-eb35baea7b53 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:17.621851 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-a40d796a-b794-4b10-9ff0-eb35baea7b53 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.158637 Jun 07 08:40:17.622418 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 129/266] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:17 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:17.737190 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-3c337461-9cde-40d6-8f16-7d8175c38827 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:17.745892 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-3c337461-9cde-40d6-8f16-7d8175c38827 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:17.747396 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-3c337461-9cde-40d6-8f16-7d8175c38827 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:17.748562 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-3c337461-9cde-40d6-8f16-7d8175c38827 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1724 microversion: 2.20 time: 0.175869 Jun 07 08:40:17.749155 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 138/267] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:17 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:40:18.556738 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-a8f8be09-1a4e-4963-89a5-c20a32ff1a55 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:18.557378 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-a8f8be09-1a4e-4963-89a5-c20a32ff1a55 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: 96c29268-a0e7-41b2-9a4e-145dc92445f1] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:18.564613 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a8f8be09-1a4e-4963-89a5-c20a32ff1a55 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:18.565088 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a8f8be09-1a4e-4963-89a5-c20a32ff1a55 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:18.565858 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a8f8be09-1a4e-4963-89a5-c20a32ff1a55 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:18.566285 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a8f8be09-1a4e-4963-89a5-c20a32ff1a55 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:18.638788 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-6936b8a0-3b9a-49fe-a428-e0815fa4eaa1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:18.639390 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-6936b8a0-3b9a-49fe-a428-e0815fa4eaa1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:18.646147 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6936b8a0-3b9a-49fe-a428-e0815fa4eaa1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:18.646595 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6936b8a0-3b9a-49fe-a428-e0815fa4eaa1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:18.647365 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6936b8a0-3b9a-49fe-a428-e0815fa4eaa1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:18.647802 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6936b8a0-3b9a-49fe-a428-e0815fa4eaa1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:18.701966 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-a8f8be09-1a4e-4963-89a5-c20a32ff1a55 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:18.709623 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-a8f8be09-1a4e-4963-89a5-c20a32ff1a55 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1" status: 200 len: 1504 microversion: 2.1 time: 0.156629 Jun 07 08:40:18.710130 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 130/268] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:18 2022] GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:18.768372 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-fc6fb84b-a9b8-4a5c-b97d-77daffbb3429 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:18.769013 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-fc6fb84b-a9b8-4a5c-b97d-77daffbb3429 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:18.775187 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fc6fb84b-a9b8-4a5c-b97d-77daffbb3429 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:18.775649 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fc6fb84b-a9b8-4a5c-b97d-77daffbb3429 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:18.776426 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fc6fb84b-a9b8-4a5c-b97d-77daffbb3429 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:18.776868 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fc6fb84b-a9b8-4a5c-b97d-77daffbb3429 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:18.785796 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-6936b8a0-3b9a-49fe-a428-e0815fa4eaa1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:18.793731 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-6936b8a0-3b9a-49fe-a428-e0815fa4eaa1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.158728 Jun 07 08:40:18.794322 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 139/269] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:18 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:40:18.910262 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-fc6fb84b-a9b8-4a5c-b97d-77daffbb3429 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:18.918848 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-fc6fb84b-a9b8-4a5c-b97d-77daffbb3429 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:18.920376 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-fc6fb84b-a9b8-4a5c-b97d-77daffbb3429 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:18.921693 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-fc6fb84b-a9b8-4a5c-b97d-77daffbb3429 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1724 microversion: 2.20 time: 0.157224 Jun 07 08:40:18.922249 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 131/270] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:18 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:40:19.727181 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-a468fde5-0d9e-44f0-88bc-618326cc0a38 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:19.727826 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-a468fde5-0d9e-44f0-88bc-618326cc0a38 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: 96c29268-a0e7-41b2-9a4e-145dc92445f1] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:19.730536 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:40:19.735536 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a468fde5-0d9e-44f0-88bc-618326cc0a38 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:19.735978 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a468fde5-0d9e-44f0-88bc-618326cc0a38 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:19.736746 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a468fde5-0d9e-44f0-88bc-618326cc0a38 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:19.737215 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a468fde5-0d9e-44f0-88bc-618326cc0a38 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:19.813214 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-2efc15b4-49ea-49cc-9e4b-b735537d93c6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:19.813883 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-2efc15b4-49ea-49cc-9e4b-b735537d93c6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:19.822857 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2efc15b4-49ea-49cc-9e4b-b735537d93c6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:19.823506 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2efc15b4-49ea-49cc-9e4b-b735537d93c6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:19.824442 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2efc15b4-49ea-49cc-9e4b-b735537d93c6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:19.825036 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2efc15b4-49ea-49cc-9e4b-b735537d93c6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:19.876784 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-a468fde5-0d9e-44f0-88bc-618326cc0a38 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:19.884862 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-a468fde5-0d9e-44f0-88bc-618326cc0a38 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1" status: 200 len: 1504 microversion: 2.1 time: 0.161932 Jun 07 08:40:19.885447 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 140/271] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:19 2022] GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:19.940625 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-a87c953e-3cbb-42e5-ba6e-9be14fe25970 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:19.941269 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-a87c953e-3cbb-42e5-ba6e-9be14fe25970 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:19.948159 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a87c953e-3cbb-42e5-ba6e-9be14fe25970 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:19.948604 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a87c953e-3cbb-42e5-ba6e-9be14fe25970 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:19.949443 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a87c953e-3cbb-42e5-ba6e-9be14fe25970 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:19.949873 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a87c953e-3cbb-42e5-ba6e-9be14fe25970 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:19.966362 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-2efc15b4-49ea-49cc-9e4b-b735537d93c6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:19.973281 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-2efc15b4-49ea-49cc-9e4b-b735537d93c6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1501 microversion: 2.1 time: 0.164915 Jun 07 08:40:19.974513 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 132/272] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:19 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1501 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:40:19.993394 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-e8597572-ce91-444e-8fc1-8394c303eab7 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b445e44a-da3b-48e3-bb28-9ac0f80b4f99"}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:40:19.994575 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-e8597572-ce91-444e-8fc1-8394c303eab7 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:20.000825 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e8597572-ce91-444e-8fc1-8394c303eab7 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:20.001311 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e8597572-ce91-444e-8fc1-8394c303eab7 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:20.003467 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e8597572-ce91-444e-8fc1-8394c303eab7 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:20.003467 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e8597572-ce91-444e-8fc1-8394c303eab7 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:20.032410 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.wsgi [None req-e8597572-ce91-444e-8fc1-8394c303eab7 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] HTTP exception thrown: Cannot 'attach_volume' instance d40b0293-76f4-4ef2-9bfa-dda971ade7ea while it is in vm_state rescued Jun 07 08:40:20.032513 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-e8597572-ce91-444e-8fc1-8394c303eab7 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Request method failure captured: Jun 07 08:40:20.032513 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: request: POST /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea/os-volume_attachments HTTP/1.1 Jun 07 08:40:20.032513 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept: application/json Jun 07 08:40:20.032513 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept-Encoding: identity Jun 07 08:40:20.032513 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Connection: close Jun 07 08:40:20.032513 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Length: 74 Jun 07 08:40:20.032513 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Type: application/json Jun 07 08:40:20.032513 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Host: 10.222.0.17 Jun 07 08:40:20.032513 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Openstack-System-Scope: None Jun 07 08:40:20.032513 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: User-Agent: python-urllib3/1.26.9 Jun 07 08:40:20.032513 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Auth-Token: gAAAAABinw56gFqEMZtH-I0OxhDG-zG6My9swmCke2xrKyH-Hi3vn7-umR3bhinsgBM-VBrrIJFaQdJKLbe8_s6_ve07jIkgyhtY0t3tA8s4W3pn-RsLOgTMCSA2ud98s6n92bGn7O40KljBfpr0883mO-X5ZsF73uXRGoWztv8PfwpUy-0skp0 Jun 07 08:40:20.032513 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Id: None Jun 07 08:40:20.032513 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Name: None Jun 07 08:40:20.032513 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Identity-Status: Confirmed Jun 07 08:40:20.032513 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Is-Admin-Project: True Jun 07 08:40:20.032513 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Id: default Jun 07 08:40:20.032513 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Name: Default Jun 07 08:40:20.032513 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Id: 10b79d91933b4f7f9f32d66138e18373 Jun 07 08:40:20.032513 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-311181591 Jun 07 08:40:20.032513 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Role: reader,member Jun 07 08:40:20.032513 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Roles: reader,member Jun 07 08:40:20.033985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/10b79d91933b4f7f9f32d66138e18373"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/10b79d91933b4f7f9f32d66138e18373"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_10b79d91933b4f7f9f32d66138e18373", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/10b79d91933b4f7f9f32d66138e18373"}]}] Jun 07 08:40:20.033985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant: tempest-ServerRescueNegativeTestJSON-311181591 Jun 07 08:40:20.033985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Id: 10b79d91933b4f7f9f32d66138e18373 Jun 07 08:40:20.033985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-311181591 Jun 07 08:40:20.033985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User: tempest-ServerRescueNegativeTestJSON-311181591-project Jun 07 08:40:20.033985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Id: default Jun 07 08:40:20.033985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Name: Default Jun 07 08:40:20.033985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Id: 055ec8a54bdf400fac0a46b0e5497f1b Jun 07 08:40:20.033985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Name: tempest-ServerRescueNegativeTestJSON-311181591-project Jun 07 08:40:20.033985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Jun 07 08:40:20.033985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: {"volumeAttachment": {"volumeId": "b445e44a-da3b-48e3-bb28-9ac0f80b4f99"}} Jun 07 08:40:20.033985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: method: > Jun 07 08:40:20.034712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: exception: Cannot 'attach_volume' instance d40b0293-76f4-4ef2-9bfa-dda971ade7ea while it is in vm_state rescued Jun 07 08:40:20.034712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: action_args: {'server_id': 'd40b0293-76f4-4ef2-9bfa-dda971ade7ea', 'body': {'volumeAttachment': {'volumeId': 'b445e44a-da3b-48e3-bb28-9ac0f80b4f99'}}} Jun 07 08:40:20.034712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:40:20.034712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:40:20.034712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 07 08:40:20.034712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 07 08:40:20.034712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 08:40:20.034712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 08:40:20.034712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 07 08:40:20.034712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 07 08:40:20.034712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d40b0293-76f4-4ef2-9bfa-dda971ade7ea in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 07 08:40:20.034712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:40:20.034712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:40:20.034712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:40:20.034712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:40:20.034712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:40:20.034712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:40:20.034712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:40:20.034712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:40:20.035787 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:40:20.035787 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:40:20.035787 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 08:40:20.035787 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 08:40:20.035787 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 08:40:20.035787 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 08:40:20.035787 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 08:40:20.035787 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 08:40:20.035787 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 07 08:40:20.035787 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 07 08:40:20.035787 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 07 08:40:20.035787 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 07 08:40:20.035787 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d40b0293-76f4-4ef2-9bfa-dda971ade7ea while it is in vm_state rescued Jun 07 08:40:20.035787 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:40:20.035787 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:40:20.035787 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:40:20.035787 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:40:20.035787 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:40:20.035787 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:40:20.037582 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:40:20.037582 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:40:20.037582 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d40b0293-76f4-4ef2-9bfa-dda971ade7ea while it is in vm_state rescued Jun 07 08:40:20.037582 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:40:20.037582 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-e8597572-ce91-444e-8fc1-8394c303eab7 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Returning 409 to user: Cannot 'attach_volume' instance d40b0293-76f4-4ef2-9bfa-dda971ade7ea while it is in vm_state rescued {{(pid=129726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:40:20.037582 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-e8597572-ce91-444e-8fc1-8394c303eab7 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "POST /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045116 Jun 07 08:40:20.037582 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 133/273] 10.222.0.17 () {60 vars in 1322 bytes} [Tue Jun 7 08:40:19 2022] POST /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 07 08:40:20.043989 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-d37051d0-91a7-40cd-975d-d3a7310c0d64 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:40:20.044483 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-d37051d0-91a7-40cd-975d-d3a7310c0d64 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:20.050975 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d37051d0-91a7-40cd-975d-d3a7310c0d64 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:20.051474 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d37051d0-91a7-40cd-975d-d3a7310c0d64 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:20.052934 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d37051d0-91a7-40cd-975d-d3a7310c0d64 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:20.053403 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d37051d0-91a7-40cd-975d-d3a7310c0d64 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:20.145275 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-a87c953e-3cbb-42e5-ba6e-9be14fe25970 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:20.154253 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-a87c953e-3cbb-42e5-ba6e-9be14fe25970 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:20.155769 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-a87c953e-3cbb-42e5-ba6e-9be14fe25970 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:20.156920 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-a87c953e-3cbb-42e5-ba6e-9be14fe25970 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1724 microversion: 2.20 time: 0.220321 Jun 07 08:40:20.157609 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 141/274] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:19 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:40:20.349976 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-d37051d0-91a7-40cd-975d-d3a7310c0d64 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "POST /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea/action" status: 202 len: 0 microversion: 2.1 time: 0.308705 Jun 07 08:40:20.350697 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 134/275] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jun 7 08:40:20 2022] POST /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 08:40:20.364089 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-90a058ca-a852-447c-b374-e11d3b06e1a1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:20.365016 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-90a058ca-a852-447c-b374-e11d3b06e1a1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:20.371520 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-90a058ca-a852-447c-b374-e11d3b06e1a1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:20.372495 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-90a058ca-a852-447c-b374-e11d3b06e1a1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:20.372913 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-90a058ca-a852-447c-b374-e11d3b06e1a1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:20.373463 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-90a058ca-a852-447c-b374-e11d3b06e1a1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:20.598355 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-90a058ca-a852-447c-b374-e11d3b06e1a1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:20.601651 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=100 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:40:20.614341 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-90a058ca-a852-447c-b374-e11d3b06e1a1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1509 microversion: 2.1 time: 0.252617 Jun 07 08:40:20.614341 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 142/276] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:20 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1509 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:20.905560 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-d160e3cc-f3d5-446e-9db3-a4250d4c55b7 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:20.911990 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-d160e3cc-f3d5-446e-9db3-a4250d4c55b7 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: 96c29268-a0e7-41b2-9a4e-145dc92445f1] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:20.920626 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d160e3cc-f3d5-446e-9db3-a4250d4c55b7 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:20.921130 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d160e3cc-f3d5-446e-9db3-a4250d4c55b7 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:20.921898 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d160e3cc-f3d5-446e-9db3-a4250d4c55b7 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:20.922327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d160e3cc-f3d5-446e-9db3-a4250d4c55b7 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:21.001478 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-3f157677-b116-4d2e-b62e-d11d2ca2edb0 req-2d0607a5-ae3d-46cb-b499-6c7bc53cce35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96c29268-a0e7-41b2-9a4e-145dc92445f1", "name": "network-vif-deleted", "tag": "a7405d01-b204-4f45-a2f8-5b34b3d10ffe"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:40:21.010987 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-3f157677-b116-4d2e-b62e-d11d2ca2edb0 req-2d0607a5-ae3d-46cb-b499-6c7bc53cce35 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:21.011525 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-3f157677-b116-4d2e-b62e-d11d2ca2edb0 req-2d0607a5-ae3d-46cb-b499-6c7bc53cce35 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:21.027870 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-d160e3cc-f3d5-446e-9db3-a4250d4c55b7 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:21.028034 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-3f157677-b116-4d2e-b62e-d11d2ca2edb0 req-2d0607a5-ae3d-46cb-b499-6c7bc53cce35 service nova] Creating event network-vif-deleted:a7405d01-b204-4f45-a2f8-5b34b3d10ffe for instance 96c29268-a0e7-41b2-9a4e-145dc92445f1 on hv-cinder-74014 Jun 07 08:40:21.030589 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-3f157677-b116-4d2e-b62e-d11d2ca2edb0 req-2d0607a5-ae3d-46cb-b499-6c7bc53cce35 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034543 Jun 07 08:40:21.031258 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 143/277] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:40:21.038842 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-d160e3cc-f3d5-446e-9db3-a4250d4c55b7 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1" status: 200 len: 1462 microversion: 2.1 time: 0.129452 Jun 07 08:40:21.039549 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 135/278] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:20 2022] GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1 => generated 1462 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:21.176029 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-bb1119cb-58ea-44c1-b213-bcfad4fc7ec8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:21.176728 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-bb1119cb-58ea-44c1-b213-bcfad4fc7ec8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:21.183364 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-bb1119cb-58ea-44c1-b213-bcfad4fc7ec8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:21.183871 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-bb1119cb-58ea-44c1-b213-bcfad4fc7ec8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:21.184660 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-bb1119cb-58ea-44c1-b213-bcfad4fc7ec8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:21.185117 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-bb1119cb-58ea-44c1-b213-bcfad4fc7ec8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:21.324225 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-bb1119cb-58ea-44c1-b213-bcfad4fc7ec8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:21.332261 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-bb1119cb-58ea-44c1-b213-bcfad4fc7ec8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:21.334365 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-bb1119cb-58ea-44c1-b213-bcfad4fc7ec8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:21.335523 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-bb1119cb-58ea-44c1-b213-bcfad4fc7ec8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1724 microversion: 2.20 time: 0.163770 Jun 07 08:40:21.336084 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 144/279] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:21 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:40:21.631139 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-7060202d-811c-4322-a5dd-3802f3445f37 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:21.631688 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-7060202d-811c-4322-a5dd-3802f3445f37 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:21.637879 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7060202d-811c-4322-a5dd-3802f3445f37 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:21.638329 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7060202d-811c-4322-a5dd-3802f3445f37 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:21.639157 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7060202d-811c-4322-a5dd-3802f3445f37 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:21.639774 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7060202d-811c-4322-a5dd-3802f3445f37 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:21.775080 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-7060202d-811c-4322-a5dd-3802f3445f37 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:21.782455 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-7060202d-811c-4322-a5dd-3802f3445f37 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1509 microversion: 2.1 time: 0.155852 Jun 07 08:40:21.783278 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 136/280] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:21 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:40:22.056474 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-c849a2bc-f241-4e9e-a111-64a4079f64eb tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:22.057684 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-c849a2bc-f241-4e9e-a111-64a4079f64eb tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: 96c29268-a0e7-41b2-9a4e-145dc92445f1] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:22.064290 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c849a2bc-f241-4e9e-a111-64a4079f64eb tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:22.069178 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c849a2bc-f241-4e9e-a111-64a4079f64eb tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:22.069178 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c849a2bc-f241-4e9e-a111-64a4079f64eb tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:22.069178 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c849a2bc-f241-4e9e-a111-64a4079f64eb tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:22.097962 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c849a2bc-f241-4e9e-a111-64a4079f64eb tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:22.098995 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c849a2bc-f241-4e9e-a111-64a4079f64eb tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:22.099576 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.objects.instance [None req-c849a2bc-f241-4e9e-a111-64a4079f64eb tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lazy-loading 'fault' on Instance uuid 96c29268-a0e7-41b2-9a4e-145dc92445f1 {{(pid=129725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:40:22.144911 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-c849a2bc-f241-4e9e-a111-64a4079f64eb tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:22.153162 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-c849a2bc-f241-4e9e-a111-64a4079f64eb tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1" status: 200 len: 1304 microversion: 2.1 time: 0.101241 Jun 07 08:40:22.155241 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 145/281] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:22 2022] GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:22.353857 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-69e763c4-44b6-466e-b596-dbd0b9e3bd4f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:22.354453 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-69e763c4-44b6-466e-b596-dbd0b9e3bd4f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:22.360598 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-69e763c4-44b6-466e-b596-dbd0b9e3bd4f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:22.361066 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-69e763c4-44b6-466e-b596-dbd0b9e3bd4f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:22.361817 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-69e763c4-44b6-466e-b596-dbd0b9e3bd4f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:22.362243 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-69e763c4-44b6-466e-b596-dbd0b9e3bd4f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:22.503946 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-69e763c4-44b6-466e-b596-dbd0b9e3bd4f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:22.520037 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-69e763c4-44b6-466e-b596-dbd0b9e3bd4f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:22.522174 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-69e763c4-44b6-466e-b596-dbd0b9e3bd4f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:22.523456 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-69e763c4-44b6-466e-b596-dbd0b9e3bd4f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1724 microversion: 2.20 time: 0.173450 Jun 07 08:40:22.527201 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 137/282] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:22 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:40:22.800849 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-92a25a64-7b95-4ca1-9a46-077c25a8d6e4 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:22.801492 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-92a25a64-7b95-4ca1-9a46-077c25a8d6e4 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:22.807558 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-92a25a64-7b95-4ca1-9a46-077c25a8d6e4 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:22.807999 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-92a25a64-7b95-4ca1-9a46-077c25a8d6e4 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:22.808808 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-92a25a64-7b95-4ca1-9a46-077c25a8d6e4 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:22.809264 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-92a25a64-7b95-4ca1-9a46-077c25a8d6e4 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:22.965825 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-92a25a64-7b95-4ca1-9a46-077c25a8d6e4 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:22.986267 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-92a25a64-7b95-4ca1-9a46-077c25a8d6e4 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1509 microversion: 2.1 time: 0.190235 Jun 07 08:40:22.988514 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 146/283] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:22 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1509 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:23.173598 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-a582651f-f35c-416b-b992-917f1e3f367c tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:23.174595 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-a582651f-f35c-416b-b992-917f1e3f367c tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: 96c29268-a0e7-41b2-9a4e-145dc92445f1] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:23.188290 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a582651f-f35c-416b-b992-917f1e3f367c tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:23.188290 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a582651f-f35c-416b-b992-917f1e3f367c tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:23.188290 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a582651f-f35c-416b-b992-917f1e3f367c tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:23.188290 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a582651f-f35c-416b-b992-917f1e3f367c tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:23.232772 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a582651f-f35c-416b-b992-917f1e3f367c tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:23.233295 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a582651f-f35c-416b-b992-917f1e3f367c tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:23.233751 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.objects.instance [None req-a582651f-f35c-416b-b992-917f1e3f367c tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lazy-loading 'fault' on Instance uuid 96c29268-a0e7-41b2-9a4e-145dc92445f1 {{(pid=129726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:40:23.279694 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-a582651f-f35c-416b-b992-917f1e3f367c tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:23.289645 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-a582651f-f35c-416b-b992-917f1e3f367c tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1" status: 200 len: 1304 microversion: 2.1 time: 0.120121 Jun 07 08:40:23.289645 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 138/284] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:23 2022] GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1 => generated 1304 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:23.549995 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-87ab9559-68ac-4c55-9313-6bfc46ebac73 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:23.550606 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-87ab9559-68ac-4c55-9313-6bfc46ebac73 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:23.558496 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-87ab9559-68ac-4c55-9313-6bfc46ebac73 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:23.559093 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-87ab9559-68ac-4c55-9313-6bfc46ebac73 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:23.559993 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-87ab9559-68ac-4c55-9313-6bfc46ebac73 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:23.560426 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-87ab9559-68ac-4c55-9313-6bfc46ebac73 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:23.709970 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-87ab9559-68ac-4c55-9313-6bfc46ebac73 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:23.718244 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-87ab9559-68ac-4c55-9313-6bfc46ebac73 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:23.719770 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-87ab9559-68ac-4c55-9313-6bfc46ebac73 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:23.720949 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-87ab9559-68ac-4c55-9313-6bfc46ebac73 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1724 microversion: 2.20 time: 0.176992 Jun 07 08:40:23.721535 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 147/285] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:23 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:40:24.005758 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-431b8ec4-301c-4b7d-ac91-f8ce8fdbb5cc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:24.006375 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-431b8ec4-301c-4b7d-ac91-f8ce8fdbb5cc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:24.012442 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-431b8ec4-301c-4b7d-ac91-f8ce8fdbb5cc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:24.012852 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-431b8ec4-301c-4b7d-ac91-f8ce8fdbb5cc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:24.013881 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-431b8ec4-301c-4b7d-ac91-f8ce8fdbb5cc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:24.014371 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-431b8ec4-301c-4b7d-ac91-f8ce8fdbb5cc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:24.018670 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:40:24.146960 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-431b8ec4-301c-4b7d-ac91-f8ce8fdbb5cc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:24.155406 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-431b8ec4-301c-4b7d-ac91-f8ce8fdbb5cc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1515 microversion: 2.1 time: 0.153562 Jun 07 08:40:24.155961 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 139/286] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:24 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:24.307931 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-318e030f-b366-4e45-b837-52d5298f4bae tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:24.308581 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-318e030f-b366-4e45-b837-52d5298f4bae tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: 96c29268-a0e7-41b2-9a4e-145dc92445f1] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:24.314891 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-318e030f-b366-4e45-b837-52d5298f4bae tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:24.315339 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-318e030f-b366-4e45-b837-52d5298f4bae tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:24.316101 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-318e030f-b366-4e45-b837-52d5298f4bae tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:24.316533 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-318e030f-b366-4e45-b837-52d5298f4bae tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:24.330411 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.wsgi [None req-318e030f-b366-4e45-b837-52d5298f4bae tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] HTTP exception thrown: Instance 96c29268-a0e7-41b2-9a4e-145dc92445f1 could not be found. Jun 07 08:40:24.334363 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-318e030f-b366-4e45-b837-52d5298f4bae tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Request method failure captured: Jun 07 08:40:24.334363 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: request: GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1 HTTP/1.1 Jun 07 08:40:24.334363 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept: application/json Jun 07 08:40:24.334363 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept-Encoding: identity Jun 07 08:40:24.334363 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Connection: close Jun 07 08:40:24.334363 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Length: 0 Jun 07 08:40:24.334363 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Type: application/json Jun 07 08:40:24.334363 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Host: 10.222.0.17 Jun 07 08:40:24.334363 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Openstack-System-Scope: None Jun 07 08:40:24.334363 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: User-Agent: python-urllib3/1.26.9 Jun 07 08:40:24.334363 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Auth-Token: gAAAAABinw7TWpAv5OGgVIbLZRcMlcYgCaYfby6RMbhse5cwxHHd8pBFNF1mqLS4l4SdKnEoAIHm_mwpnHZX9saZ7gFsaKB0cJzBegh-PviAVqF1SEfA1BCZeeW2OXWyFaRss_FYaXKlqPJKXtTS-QhRiyMhTu4N_G89bElH-V0sNxbpgHwxu5c Jun 07 08:40:24.334363 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Id: None Jun 07 08:40:24.334363 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Name: None Jun 07 08:40:24.334363 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Identity-Status: Confirmed Jun 07 08:40:24.334363 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Is-Admin-Project: True Jun 07 08:40:24.334363 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Id: default Jun 07 08:40:24.334363 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Name: Default Jun 07 08:40:24.334363 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Id: be66894579564c8584bb7a4ff489ea22 Jun 07 08:40:24.334363 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Name: tempest-VolumesActionsTest-1950037314 Jun 07 08:40:24.334363 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Role: reader,member Jun 07 08:40:24.334363 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Roles: reader,member Jun 07 08:40:24.336017 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/be66894579564c8584bb7a4ff489ea22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/be66894579564c8584bb7a4ff489ea22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_be66894579564c8584bb7a4ff489ea22", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/be66894579564c8584bb7a4ff489ea22"}]}] Jun 07 08:40:24.336017 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant: tempest-VolumesActionsTest-1950037314 Jun 07 08:40:24.336017 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Id: be66894579564c8584bb7a4ff489ea22 Jun 07 08:40:24.336017 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Name: tempest-VolumesActionsTest-1950037314 Jun 07 08:40:24.336017 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User: tempest-VolumesActionsTest-1950037314-project Jun 07 08:40:24.336017 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Id: default Jun 07 08:40:24.336017 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Name: Default Jun 07 08:40:24.336017 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Id: 489306774e664047a2a5629048455686 Jun 07 08:40:24.336017 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Name: tempest-VolumesActionsTest-1950037314-project Jun 07 08:40:24.336017 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: method: > Jun 07 08:40:24.336017 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: exception: Instance 96c29268-a0e7-41b2-9a4e-145dc92445f1 could not be found. Jun 07 08:40:24.336017 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: action_args: {'id': '96c29268-a0e7-41b2-9a4e-145dc92445f1'} Jun 07 08:40:24.336927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:40:24.336927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:40:24.336927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:40:24.336927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:40:24.336927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:40:24.336927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:40:24.336927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:40:24.336927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:40:24.336927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:40:24.336927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:40:24.336927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96c29268-a0e7-41b2-9a4e-145dc92445f1 could not be found. Jun 07 08:40:24.336927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:40:24.336927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:40:24.336927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:40:24.336927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:40:24.336927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:40:24.336927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:40:24.336927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:40:24.336927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:40:24.336927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:40:24.338278 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:40:24.338278 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 08:40:24.338278 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 08:40:24.338278 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:40:24.338278 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:40:24.338278 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:40:24.338278 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:40:24.338278 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96c29268-a0e7-41b2-9a4e-145dc92445f1 could not be found. Jun 07 08:40:24.338278 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:40:24.338278 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:40:24.338278 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:40:24.338278 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:40:24.338278 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:40:24.338278 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:40:24.338278 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:40:24.338278 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:40:24.338278 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96c29268-a0e7-41b2-9a4e-145dc92445f1 could not be found. Jun 07 08:40:24.338278 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:40:24.339537 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-318e030f-b366-4e45-b837-52d5298f4bae tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Returning 404 to user: Instance 96c29268-a0e7-41b2-9a4e-145dc92445f1 could not be found. {{(pid=129725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:40:24.339537 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-318e030f-b366-4e45-b837-52d5298f4bae tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1" status: 404 len: 111 microversion: 2.1 time: 0.031002 Jun 07 08:40:24.339537 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 148/287] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:24 2022] GET /compute/v2.1/servers/96c29268-a0e7-41b2-9a4e-145dc92445f1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:40:24.447879 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-651058cb-85a1-4520-bb9f-eccde4f0590e tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1519659361", "imageRef": "c04b0a92-7675-47c3-bcc2-8a2a59b997c3", "flavorRef": "452", "networks": [{"uuid": "f4edf7e7-0962-4b4e-9f17-0754b12271de"}]}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:40:24.504374 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.network.neutron [None req-651058cb-85a1-4520-bb9f-eccde4f0590e tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] validate_networks() for [('f4edf7e7-0962-4b4e-9f17-0754b12271de', None, None, None, None, None)] {{(pid=129726) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 08:40:24.738773 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-118a1ad4-1628-4ab6-8808-fda4f3e80255 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:24.739395 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-118a1ad4-1628-4ab6-8808-fda4f3e80255 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:24.747208 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-118a1ad4-1628-4ab6-8808-fda4f3e80255 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:24.747901 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-118a1ad4-1628-4ab6-8808-fda4f3e80255 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:24.748693 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-118a1ad4-1628-4ab6-8808-fda4f3e80255 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:24.749164 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-118a1ad4-1628-4ab6-8808-fda4f3e80255 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:24.888536 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-118a1ad4-1628-4ab6-8808-fda4f3e80255 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:24.897046 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-118a1ad4-1628-4ab6-8808-fda4f3e80255 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:24.899157 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-118a1ad4-1628-4ab6-8808-fda4f3e80255 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:24.900315 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-118a1ad4-1628-4ab6-8808-fda4f3e80255 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1724 microversion: 2.20 time: 0.165477 Jun 07 08:40:24.900880 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 149/288] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:24 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:40:24.901628 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-651058cb-85a1-4520-bb9f-eccde4f0590e tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Flavor limits 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 08:40:24.902129 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-651058cb-85a1-4520-bb9f-eccde4f0590e tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Image limits 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 08:40:24.902679 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-651058cb-85a1-4520-bb9f-eccde4f0590e tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Flavor pref 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 08:40:24.903164 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-651058cb-85a1-4520-bb9f-eccde4f0590e tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Image pref 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 08:40:24.903647 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-651058cb-85a1-4520-bb9f-eccde4f0590e tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 08:40:24.915763 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-651058cb-85a1-4520-bb9f-eccde4f0590e tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:24.916884 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-651058cb-85a1-4520-bb9f-eccde4f0590e tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:24.917735 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-651058cb-85a1-4520-bb9f-eccde4f0590e tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:24.918180 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-651058cb-85a1-4520-bb9f-eccde4f0590e tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:24.936876 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-651058cb-85a1-4520-bb9f-eccde4f0590e tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Getting quotas for project be66894579564c8584bb7a4ff489ea22. Resources: {'ram', 'cores', 'instances'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 08:40:24.940963 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-651058cb-85a1-4520-bb9f-eccde4f0590e tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Getting quotas for user 489306774e664047a2a5629048455686 and project be66894579564c8584bb7a4ff489ea22. Resources: {'ram', 'cores', 'instances'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 08:40:24.952989 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-651058cb-85a1-4520-bb9f-eccde4f0590e tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Going to run 1 instances... {{(pid=129726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 08:40:24.955371 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-651058cb-85a1-4520-bb9f-eccde4f0590e tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: b45b99f6-03d4-4906-9ce3-db22d9cd9ec2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c04b0a92-7675-47c3-bcc2-8a2a59b997c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 08:40:25.056351 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-651058cb-85a1-4520-bb9f-eccde4f0590e tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.613107 Jun 07 08:40:25.057504 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 140/289] 10.222.0.17 () {60 vars in 1146 bytes} [Tue Jun 7 08:40:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 08:40:25.067622 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-41ee7f22-eec9-402d-90bc-57f92e9caf5f tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:25.068641 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-41ee7f22-eec9-402d-90bc-57f92e9caf5f tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: b45b99f6-03d4-4906-9ce3-db22d9cd9ec2] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:25.124149 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-41ee7f22-eec9-402d-90bc-57f92e9caf5f tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:25.131743 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-41ee7f22-eec9-402d-90bc-57f92e9caf5f tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2" status: 200 len: 1214 microversion: 2.1 time: 0.067800 Jun 07 08:40:25.132112 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 150/290] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:25 2022] GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:40:25.918539 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-55443689-a0a5-4b22-9521-368ddfca7347 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:25.919152 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-55443689-a0a5-4b22-9521-368ddfca7347 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:25.925559 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-55443689-a0a5-4b22-9521-368ddfca7347 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:25.926011 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-55443689-a0a5-4b22-9521-368ddfca7347 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:25.926787 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-55443689-a0a5-4b22-9521-368ddfca7347 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:25.927227 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-55443689-a0a5-4b22-9521-368ddfca7347 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:26.063225 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-55443689-a0a5-4b22-9521-368ddfca7347 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:26.071696 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-55443689-a0a5-4b22-9521-368ddfca7347 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:26.073214 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-55443689-a0a5-4b22-9521-368ddfca7347 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:26.074363 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-55443689-a0a5-4b22-9521-368ddfca7347 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1724 microversion: 2.20 time: 0.159848 Jun 07 08:40:26.075361 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 141/291] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:25 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:40:26.148867 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-3a214693-17b6-4dd3-8f4c-a045a3ec4714 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:26.149689 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-3a214693-17b6-4dd3-8f4c-a045a3ec4714 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: b45b99f6-03d4-4906-9ce3-db22d9cd9ec2] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:26.156669 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3a214693-17b6-4dd3-8f4c-a045a3ec4714 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:26.157149 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3a214693-17b6-4dd3-8f4c-a045a3ec4714 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:26.158190 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3a214693-17b6-4dd3-8f4c-a045a3ec4714 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:26.158626 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3a214693-17b6-4dd3-8f4c-a045a3ec4714 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:26.220820 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-3a214693-17b6-4dd3-8f4c-a045a3ec4714 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:26.228449 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-3a214693-17b6-4dd3-8f4c-a045a3ec4714 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2" status: 200 len: 1218 microversion: 2.1 time: 0.084144 Jun 07 08:40:26.229120 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 151/292] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:26 2022] GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:40:27.092845 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-24c6c17a-7db2-44ae-ac62-373bbd87bc92 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:27.093456 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-24c6c17a-7db2-44ae-ac62-373bbd87bc92 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:27.099973 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-24c6c17a-7db2-44ae-ac62-373bbd87bc92 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:27.100558 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-24c6c17a-7db2-44ae-ac62-373bbd87bc92 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:27.101473 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-24c6c17a-7db2-44ae-ac62-373bbd87bc92 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:27.101908 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-24c6c17a-7db2-44ae-ac62-373bbd87bc92 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:27.247281 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-ac26ae01-fc28-48b3-b645-31adb37cc0d9 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:27.249276 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-ac26ae01-fc28-48b3-b645-31adb37cc0d9 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: b45b99f6-03d4-4906-9ce3-db22d9cd9ec2] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:27.259481 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ac26ae01-fc28-48b3-b645-31adb37cc0d9 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:27.265239 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ac26ae01-fc28-48b3-b645-31adb37cc0d9 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:27.265239 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ac26ae01-fc28-48b3-b645-31adb37cc0d9 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:27.265239 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ac26ae01-fc28-48b3-b645-31adb37cc0d9 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:27.266403 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-24c6c17a-7db2-44ae-ac62-373bbd87bc92 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:27.282340 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-24c6c17a-7db2-44ae-ac62-373bbd87bc92 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:27.285973 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-24c6c17a-7db2-44ae-ac62-373bbd87bc92 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:27.292354 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-24c6c17a-7db2-44ae-ac62-373bbd87bc92 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1745 microversion: 2.20 time: 0.201149 Jun 07 08:40:27.292354 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 142/293] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:27 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1745 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:40:27.330515 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-ac26ae01-fc28-48b3-b645-31adb37cc0d9 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:27.343012 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-ac26ae01-fc28-48b3-b645-31adb37cc0d9 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2" status: 200 len: 1266 microversion: 2.1 time: 0.101268 Jun 07 08:40:27.343690 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 152/294] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:27 2022] GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:27.863907 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-e307aca8-d90d-4637-b626-82bc2b2362ee tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Action: 'create', calling method: .version_select at 0x7f7fececf700>, body: {"keypair": {"name": "tempest-keypair-1831763891", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBtzvCwq04qCgxfv4+u27UJjF1jN5/h0c/uwgXGzBwWAa+nEkwcNJH+e4G434FKNGOhhnDaNvXReOtgAbyuHlofqjuYvEFY7V/n6cAzIRibO2ocHMDr6mRLrEOcBHR3iw=="}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:40:27.899630 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-e307aca8-d90d-4637-b626-82bc2b2362ee tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Getting quotas for project 10b79d91933b4f7f9f32d66138e18373. Resources: {'key_pairs'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 08:40:27.908271 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-e307aca8-d90d-4637-b626-82bc2b2362ee tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Getting quotas for user 055ec8a54bdf400fac0a46b0e5497f1b and project 10b79d91933b4f7f9f32d66138e18373. Resources: {'key_pairs'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 08:40:28.073626 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-e307aca8-d90d-4637-b626-82bc2b2362ee tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.214316 Jun 07 08:40:28.085864 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 143/295] 10.222.0.17 () {60 vars in 1158 bytes} [Tue Jun 7 08:40:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:40:28.312087 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-64fb0553-4543-4643-8e58-0fc7ffbf7f99 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:28.312870 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-64fb0553-4543-4643-8e58-0fc7ffbf7f99 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:28.322181 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-64fb0553-4543-4643-8e58-0fc7ffbf7f99 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:28.322722 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-64fb0553-4543-4643-8e58-0fc7ffbf7f99 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:28.323576 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-64fb0553-4543-4643-8e58-0fc7ffbf7f99 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:28.324105 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-64fb0553-4543-4643-8e58-0fc7ffbf7f99 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:28.361082 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-7cf8990b-5bfd-418d-bf00-9de38ed5a9b7 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:28.362544 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-7cf8990b-5bfd-418d-bf00-9de38ed5a9b7 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: b45b99f6-03d4-4906-9ce3-db22d9cd9ec2] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:28.372707 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7cf8990b-5bfd-418d-bf00-9de38ed5a9b7 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:28.373472 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7cf8990b-5bfd-418d-bf00-9de38ed5a9b7 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:28.374629 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7cf8990b-5bfd-418d-bf00-9de38ed5a9b7 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:28.375245 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7cf8990b-5bfd-418d-bf00-9de38ed5a9b7 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:28.516207 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-64fb0553-4543-4643-8e58-0fc7ffbf7f99 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:28.526197 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-64fb0553-4543-4643-8e58-0fc7ffbf7f99 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:28.527720 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-64fb0553-4543-4643-8e58-0fc7ffbf7f99 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:28.528925 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-64fb0553-4543-4643-8e58-0fc7ffbf7f99 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1745 microversion: 2.20 time: 0.221548 Jun 07 08:40:28.529586 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 153/296] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:28 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1745 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:40:28.797497 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-7cf8990b-5bfd-418d-bf00-9de38ed5a9b7 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:28.806158 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-7cf8990b-5bfd-418d-bf00-9de38ed5a9b7 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2" status: 200 len: 1314 microversion: 2.1 time: 0.450096 Jun 07 08:40:28.806811 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 144/297] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:28 2022] GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:29.547826 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-3092bf7d-24a5-47a9-9035-cf7b6a13cbc4 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:29.548512 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-3092bf7d-24a5-47a9-9035-cf7b6a13cbc4 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:29.556106 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3092bf7d-24a5-47a9-9035-cf7b6a13cbc4 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:29.556486 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3092bf7d-24a5-47a9-9035-cf7b6a13cbc4 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:29.557291 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3092bf7d-24a5-47a9-9035-cf7b6a13cbc4 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:29.557727 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3092bf7d-24a5-47a9-9035-cf7b6a13cbc4 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:29.766887 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-3092bf7d-24a5-47a9-9035-cf7b6a13cbc4 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:29.777546 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-3092bf7d-24a5-47a9-9035-cf7b6a13cbc4 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:29.779066 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-3092bf7d-24a5-47a9-9035-cf7b6a13cbc4 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:29.780240 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-3092bf7d-24a5-47a9-9035-cf7b6a13cbc4 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1745 microversion: 2.20 time: 0.236506 Jun 07 08:40:29.780797 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 154/298] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:29 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1745 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:40:29.824475 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-550151fe-87fa-47e8-8815-973e4220eacd tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:29.825736 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-550151fe-87fa-47e8-8815-973e4220eacd tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: b45b99f6-03d4-4906-9ce3-db22d9cd9ec2] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:29.834341 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-550151fe-87fa-47e8-8815-973e4220eacd tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:29.834807 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-550151fe-87fa-47e8-8815-973e4220eacd tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:29.835707 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-550151fe-87fa-47e8-8815-973e4220eacd tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:29.836294 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-550151fe-87fa-47e8-8815-973e4220eacd tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:30.024261 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-550151fe-87fa-47e8-8815-973e4220eacd tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:30.034265 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-550151fe-87fa-47e8-8815-973e4220eacd tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2" status: 200 len: 1314 microversion: 2.1 time: 0.214448 Jun 07 08:40:30.034977 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 145/299] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:29 2022] GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:30.799562 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-757a22a9-3241-4e37-b456-bc81c5d89d98 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:30.800694 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-757a22a9-3241-4e37-b456-bc81c5d89d98 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:30.808113 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-757a22a9-3241-4e37-b456-bc81c5d89d98 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:30.808470 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-757a22a9-3241-4e37-b456-bc81c5d89d98 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:30.809270 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-757a22a9-3241-4e37-b456-bc81c5d89d98 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:30.809709 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-757a22a9-3241-4e37-b456-bc81c5d89d98 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:30.910620 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-85516e00-13a0-4994-8412-5540b1f6d034 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1644664331", "imageRef": "c04b0a92-7675-47c3-bcc2-8a2a59b997c3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5db4407e-2ca4-47e4-aa62-77735c5013d3"}], "security_groups": [{"name": "tempest-securitygroup--49404205"}], "key_name": "tempest-keypair-1831763891", "user_data": "}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:40:30.972102 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-757a22a9-3241-4e37-b456-bc81c5d89d98 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:30.981300 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-757a22a9-3241-4e37-b456-bc81c5d89d98 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:30.982924 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-757a22a9-3241-4e37-b456-bc81c5d89d98 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:30.984038 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-757a22a9-3241-4e37-b456-bc81c5d89d98 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1745 microversion: 2.20 time: 0.188546 Jun 07 08:40:30.987408 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 155/300] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:30 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1745 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:40:31.030209 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.network.neutron [None req-85516e00-13a0-4994-8412-5540b1f6d034 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] validate_networks() for [('5db4407e-2ca4-47e4-aa62-77735c5013d3', None, None, None, None, None)] {{(pid=129726) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 08:40:31.052572 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-e9e3c5f1-e95b-432c-a1ca-77fa89508d2f tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:31.052716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-e9e3c5f1-e95b-432c-a1ca-77fa89508d2f tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: b45b99f6-03d4-4906-9ce3-db22d9cd9ec2] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:31.059918 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e9e3c5f1-e95b-432c-a1ca-77fa89508d2f tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:31.060323 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e9e3c5f1-e95b-432c-a1ca-77fa89508d2f tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:31.061319 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e9e3c5f1-e95b-432c-a1ca-77fa89508d2f tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:31.061823 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e9e3c5f1-e95b-432c-a1ca-77fa89508d2f tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:31.214539 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-e9e3c5f1-e95b-432c-a1ca-77fa89508d2f tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:31.222116 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-e9e3c5f1-e95b-432c-a1ca-77fa89508d2f tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2" status: 200 len: 1314 microversion: 2.1 time: 0.174279 Jun 07 08:40:31.227386 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 156/301] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:31 2022] GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:40:31.428055 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-85516e00-13a0-4994-8412-5540b1f6d034 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Flavor limits 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 08:40:31.428480 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-85516e00-13a0-4994-8412-5540b1f6d034 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Image limits 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 08:40:31.428952 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-85516e00-13a0-4994-8412-5540b1f6d034 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Flavor pref 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 08:40:31.429423 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-85516e00-13a0-4994-8412-5540b1f6d034 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Image pref 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 08:40:31.429835 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-85516e00-13a0-4994-8412-5540b1f6d034 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 08:40:31.439570 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-85516e00-13a0-4994-8412-5540b1f6d034 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:31.440094 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-85516e00-13a0-4994-8412-5540b1f6d034 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:31.440919 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-85516e00-13a0-4994-8412-5540b1f6d034 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:31.441436 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-85516e00-13a0-4994-8412-5540b1f6d034 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:31.461034 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-85516e00-13a0-4994-8412-5540b1f6d034 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Getting quotas for project 10b79d91933b4f7f9f32d66138e18373. Resources: {'ram', 'cores', 'instances'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 08:40:31.464883 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-85516e00-13a0-4994-8412-5540b1f6d034 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Getting quotas for user 055ec8a54bdf400fac0a46b0e5497f1b and project 10b79d91933b4f7f9f32d66138e18373. Resources: {'ram', 'cores', 'instances'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 08:40:31.475803 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-85516e00-13a0-4994-8412-5540b1f6d034 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Going to run 1 instances... {{(pid=129726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 08:40:31.478540 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-85516e00-13a0-4994-8412-5540b1f6d034 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c04b0a92-7675-47c3-bcc2-8a2a59b997c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 08:40:31.615019 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-85516e00-13a0-4994-8412-5540b1f6d034 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.708805 Jun 07 08:40:31.615644 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 146/302] 10.222.0.17 () {60 vars in 1146 bytes} [Tue Jun 7 08:40:30 2022] POST /compute/v2.1/servers => generated 407 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 08:40:31.625903 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-848af590-c29f-472f-92fa-d1573d958578 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:31.626613 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-848af590-c29f-472f-92fa-d1573d958578 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:31.681476 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-848af590-c29f-472f-92fa-d1573d958578 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:31.690547 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-848af590-c29f-472f-92fa-d1573d958578 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1246 microversion: 2.1 time: 0.068624 Jun 07 08:40:31.691130 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 157/303] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:31 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1246 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:40:31.881867 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-2ff7aaa1-9de3-4d27-81d1-9eac74d7c3ce req-8c1679c3-3ee7-45a7-9639-ca51fe17c850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60630f0f-2831-479d-91fc-477b773635ad", "name": "network-vif-plugged", "status": "completed", "tag": "87bcbdda-ce88-44b8-b537-66a7d29ac04f"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:40:31.890875 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-2ff7aaa1-9de3-4d27-81d1-9eac74d7c3ce req-8c1679c3-3ee7-45a7-9639-ca51fe17c850 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:31.891410 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-2ff7aaa1-9de3-4d27-81d1-9eac74d7c3ce req-8c1679c3-3ee7-45a7-9639-ca51fe17c850 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:31.903581 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-2ff7aaa1-9de3-4d27-81d1-9eac74d7c3ce req-8c1679c3-3ee7-45a7-9639-ca51fe17c850 service nova] Creating event network-vif-plugged:87bcbdda-ce88-44b8-b537-66a7d29ac04f for instance 60630f0f-2831-479d-91fc-477b773635ad on hv-cinder-74014 Jun 07 08:40:31.910094 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-2ff7aaa1-9de3-4d27-81d1-9eac74d7c3ce req-8c1679c3-3ee7-45a7-9639-ca51fe17c850 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032741 Jun 07 08:40:31.910716 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 147/304] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:40:32.005588 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-021f83bf-994c-46b8-a0f5-963158727a0d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:32.006929 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-021f83bf-994c-46b8-a0f5-963158727a0d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:32.016807 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-021f83bf-994c-46b8-a0f5-963158727a0d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:32.017559 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-021f83bf-994c-46b8-a0f5-963158727a0d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:32.018587 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-021f83bf-994c-46b8-a0f5-963158727a0d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:32.019612 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-021f83bf-994c-46b8-a0f5-963158727a0d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:32.216737 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-021f83bf-994c-46b8-a0f5-963158727a0d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:32.225608 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-021f83bf-994c-46b8-a0f5-963158727a0d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:32.227157 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-021f83bf-994c-46b8-a0f5-963158727a0d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:32.228398 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-021f83bf-994c-46b8-a0f5-963158727a0d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1745 microversion: 2.20 time: 0.227194 Jun 07 08:40:32.228978 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 158/305] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:32 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1745 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:40:32.243355 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-addd29d3-261c-4d54-b4db-245871853e92 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:32.244311 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-addd29d3-261c-4d54-b4db-245871853e92 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: b45b99f6-03d4-4906-9ce3-db22d9cd9ec2] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:32.252009 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-addd29d3-261c-4d54-b4db-245871853e92 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:32.252238 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-addd29d3-261c-4d54-b4db-245871853e92 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:32.253484 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-addd29d3-261c-4d54-b4db-245871853e92 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:32.253822 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-addd29d3-261c-4d54-b4db-245871853e92 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:32.496026 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-addd29d3-261c-4d54-b4db-245871853e92 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:32.504968 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-addd29d3-261c-4d54-b4db-245871853e92 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2" status: 200 len: 1314 microversion: 2.1 time: 0.266933 Jun 07 08:40:32.508048 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 148/306] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:32 2022] GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:32.709938 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-ed03bf85-a677-4f19-8c83-2b92a6ee7284 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:32.710707 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-ed03bf85-a677-4f19-8c83-2b92a6ee7284 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:32.718454 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ed03bf85-a677-4f19-8c83-2b92a6ee7284 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:32.719048 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ed03bf85-a677-4f19-8c83-2b92a6ee7284 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:32.720170 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ed03bf85-a677-4f19-8c83-2b92a6ee7284 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:32.721285 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ed03bf85-a677-4f19-8c83-2b92a6ee7284 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:32.815533 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-ed03bf85-a677-4f19-8c83-2b92a6ee7284 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:32.819064 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-abf1aa47-77f1-490b-bdab-81eb1ff4fc91 req-3dfdd693-ccc9-46d7-bfd7-cb15f73593c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b45b99f6-03d4-4906-9ce3-db22d9cd9ec2", "tag": "d2c10949-acf3-498a-a6f4-b0e5d95e9b2a"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:40:32.825516 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-ed03bf85-a677-4f19-8c83-2b92a6ee7284 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1250 microversion: 2.1 time: 0.120153 Jun 07 08:40:32.837061 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 159/307] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:32 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1250 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:32.838778 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-abf1aa47-77f1-490b-bdab-81eb1ff4fc91 req-3dfdd693-ccc9-46d7-bfd7-cb15f73593c9 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:32.839330 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-abf1aa47-77f1-490b-bdab-81eb1ff4fc91 req-3dfdd693-ccc9-46d7-bfd7-cb15f73593c9 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:32.864186 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-abf1aa47-77f1-490b-bdab-81eb1ff4fc91 req-3dfdd693-ccc9-46d7-bfd7-cb15f73593c9 service nova] Creating event network-changed:d2c10949-acf3-498a-a6f4-b0e5d95e9b2a for instance b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 on hv-cinder-74014 Jun 07 08:40:32.870616 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-abf1aa47-77f1-490b-bdab-81eb1ff4fc91 req-3dfdd693-ccc9-46d7-bfd7-cb15f73593c9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055958 Jun 07 08:40:32.871874 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 149/308] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:40:33.274506 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-a76ed344-8e61-4819-a472-c1f549f4bb09 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:33.275265 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-a76ed344-8e61-4819-a472-c1f549f4bb09 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:33.296470 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a76ed344-8e61-4819-a472-c1f549f4bb09 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:33.297325 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a76ed344-8e61-4819-a472-c1f549f4bb09 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:33.298360 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a76ed344-8e61-4819-a472-c1f549f4bb09 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:33.299487 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a76ed344-8e61-4819-a472-c1f549f4bb09 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:33.512756 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-a76ed344-8e61-4819-a472-c1f549f4bb09 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:33.523265 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-2fac2ab3-a257-4e53-b931-790f92551e29 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:33.524031 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-2fac2ab3-a257-4e53-b931-790f92551e29 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: b45b99f6-03d4-4906-9ce3-db22d9cd9ec2] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:33.544822 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2fac2ab3-a257-4e53-b931-790f92551e29 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:33.545309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2fac2ab3-a257-4e53-b931-790f92551e29 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:33.546094 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2fac2ab3-a257-4e53-b931-790f92551e29 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:33.547767 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-a76ed344-8e61-4819-a472-c1f549f4bb09 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:33.549521 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-a76ed344-8e61-4819-a472-c1f549f4bb09 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:33.550748 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-a76ed344-8e61-4819-a472-c1f549f4bb09 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1740 microversion: 2.20 time: 0.302185 Jun 07 08:40:33.551761 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2fac2ab3-a257-4e53-b931-790f92551e29 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:33.564488 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 160/309] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:33 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1740 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:40:33.734726 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-2fac2ab3-a257-4e53-b931-790f92551e29 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:33.744606 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-2fac2ab3-a257-4e53-b931-790f92551e29 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2" status: 200 len: 1314 microversion: 2.1 time: 0.225955 Jun 07 08:40:33.745215 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 150/310] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:33 2022] GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:40:33.844080 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-9f563559-aeaa-4216-a813-470b1fc3a48e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:33.844698 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-9f563559-aeaa-4216-a813-470b1fc3a48e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:33.870992 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9f563559-aeaa-4216-a813-470b1fc3a48e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:33.878595 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9f563559-aeaa-4216-a813-470b1fc3a48e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:33.883525 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9f563559-aeaa-4216-a813-470b1fc3a48e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:33.888679 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9f563559-aeaa-4216-a813-470b1fc3a48e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:33.988632 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-9f563559-aeaa-4216-a813-470b1fc3a48e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:34.001457 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-9f563559-aeaa-4216-a813-470b1fc3a48e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1298 microversion: 2.1 time: 0.161321 Jun 07 08:40:34.002632 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 161/311] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:33 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1298 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:34.575359 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-b556e4ca-37b4-45a1-a3dd-1271cfffda5a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:34.576825 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-b556e4ca-37b4-45a1-a3dd-1271cfffda5a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:34.579141 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:40:34.585330 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b556e4ca-37b4-45a1-a3dd-1271cfffda5a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:34.587024 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b556e4ca-37b4-45a1-a3dd-1271cfffda5a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:34.588030 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b556e4ca-37b4-45a1-a3dd-1271cfffda5a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:34.589621 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b556e4ca-37b4-45a1-a3dd-1271cfffda5a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:34.764730 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-26f718cf-e972-4b42-a211-25a244db8927 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:34.765625 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-26f718cf-e972-4b42-a211-25a244db8927 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: b45b99f6-03d4-4906-9ce3-db22d9cd9ec2] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:34.778226 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-26f718cf-e972-4b42-a211-25a244db8927 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:34.788790 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-26f718cf-e972-4b42-a211-25a244db8927 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:34.788790 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-26f718cf-e972-4b42-a211-25a244db8927 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:34.788790 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-26f718cf-e972-4b42-a211-25a244db8927 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:34.824439 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=100 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:40:34.830328 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-b556e4ca-37b4-45a1-a3dd-1271cfffda5a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:34.841223 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-b556e4ca-37b4-45a1-a3dd-1271cfffda5a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:34.843139 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-b556e4ca-37b4-45a1-a3dd-1271cfffda5a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:34.844515 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-b556e4ca-37b4-45a1-a3dd-1271cfffda5a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1740 microversion: 2.20 time: 0.275538 Jun 07 08:40:34.845764 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 151/312] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:34 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1740 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:40:34.985214 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-26f718cf-e972-4b42-a211-25a244db8927 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:34.985214 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-26f718cf-e972-4b42-a211-25a244db8927 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2" status: 200 len: 1314 microversion: 2.1 time: 0.225150 Jun 07 08:40:34.985743 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 162/313] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:34 2022] GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:40:35.021113 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-45e0e18f-9122-450f-8f29-4b73710a13d2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:35.022018 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-45e0e18f-9122-450f-8f29-4b73710a13d2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:35.037466 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-45e0e18f-9122-450f-8f29-4b73710a13d2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:35.038350 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-45e0e18f-9122-450f-8f29-4b73710a13d2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:35.039388 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-45e0e18f-9122-450f-8f29-4b73710a13d2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:35.039986 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-45e0e18f-9122-450f-8f29-4b73710a13d2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:35.113660 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-45e0e18f-9122-450f-8f29-4b73710a13d2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:35.124089 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-45e0e18f-9122-450f-8f29-4b73710a13d2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1306 microversion: 2.1 time: 0.108349 Jun 07 08:40:35.130874 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 152/314] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:35 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1306 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:35.871709 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-40831698-a760-4c95-8a2b-e7bcf69b18a1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:35.874051 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-40831698-a760-4c95-8a2b-e7bcf69b18a1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:35.889919 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-40831698-a760-4c95-8a2b-e7bcf69b18a1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:35.891921 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-40831698-a760-4c95-8a2b-e7bcf69b18a1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:35.893374 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-40831698-a760-4c95-8a2b-e7bcf69b18a1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:35.894837 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-40831698-a760-4c95-8a2b-e7bcf69b18a1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:36.005008 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-2af56b3c-712d-4a39-9da2-e555ecdb3b61 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:36.006703 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-2af56b3c-712d-4a39-9da2-e555ecdb3b61 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: b45b99f6-03d4-4906-9ce3-db22d9cd9ec2] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:36.023132 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2af56b3c-712d-4a39-9da2-e555ecdb3b61 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:36.027683 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2af56b3c-712d-4a39-9da2-e555ecdb3b61 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:36.034443 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2af56b3c-712d-4a39-9da2-e555ecdb3b61 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:36.035249 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2af56b3c-712d-4a39-9da2-e555ecdb3b61 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:36.179426 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-40831698-a760-4c95-8a2b-e7bcf69b18a1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:36.209192 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-40831698-a760-4c95-8a2b-e7bcf69b18a1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:36.213720 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-40831698-a760-4c95-8a2b-e7bcf69b18a1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:36.215311 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-40831698-a760-4c95-8a2b-e7bcf69b18a1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1740 microversion: 2.20 time: 0.352545 Jun 07 08:40:36.215899 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 163/315] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:35 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1740 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:40:36.249918 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-ff4127ff-2875-4361-8a91-c6f74ae2c7ec tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:36.250613 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-ff4127ff-2875-4361-8a91-c6f74ae2c7ec tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:36.263527 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ff4127ff-2875-4361-8a91-c6f74ae2c7ec tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:36.264063 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ff4127ff-2875-4361-8a91-c6f74ae2c7ec tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:36.265037 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ff4127ff-2875-4361-8a91-c6f74ae2c7ec tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:36.268317 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ff4127ff-2875-4361-8a91-c6f74ae2c7ec tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:36.386731 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-2af56b3c-712d-4a39-9da2-e555ecdb3b61 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:36.401240 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-ff4127ff-2875-4361-8a91-c6f74ae2c7ec tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:36.410177 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-2af56b3c-712d-4a39-9da2-e555ecdb3b61 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2" status: 200 len: 1314 microversion: 2.1 time: 0.406371 Jun 07 08:40:36.411667 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-ff4127ff-2875-4361-8a91-c6f74ae2c7ec tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1304 microversion: 2.1 time: 0.187781 Jun 07 08:40:36.413406 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 164/316] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:36 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1304 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:36.425337 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 153/317] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:35 2022] GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:37.236098 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-4437e7ce-b932-46d2-8113-f72ce342448d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:37.240249 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-4437e7ce-b932-46d2-8113-f72ce342448d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:37.271859 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4437e7ce-b932-46d2-8113-f72ce342448d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:37.272715 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4437e7ce-b932-46d2-8113-f72ce342448d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:37.274039 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4437e7ce-b932-46d2-8113-f72ce342448d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:37.274725 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4437e7ce-b932-46d2-8113-f72ce342448d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:37.441557 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-7d825e0d-6877-4fb5-8025-854742dc2b82 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:37.443737 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-7d825e0d-6877-4fb5-8025-854742dc2b82 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: b45b99f6-03d4-4906-9ce3-db22d9cd9ec2] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:37.467459 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7d825e0d-6877-4fb5-8025-854742dc2b82 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:37.468336 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7d825e0d-6877-4fb5-8025-854742dc2b82 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:37.469376 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7d825e0d-6877-4fb5-8025-854742dc2b82 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:37.470106 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7d825e0d-6877-4fb5-8025-854742dc2b82 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:37.534543 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-4437e7ce-b932-46d2-8113-f72ce342448d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:37.545292 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-4437e7ce-b932-46d2-8113-f72ce342448d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:37.553636 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-4437e7ce-b932-46d2-8113-f72ce342448d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:37.553636 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-4437e7ce-b932-46d2-8113-f72ce342448d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1740 microversion: 2.20 time: 0.319065 Jun 07 08:40:37.553636 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 165/318] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:37 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1740 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:40:37.557836 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-f5721f90-2c02-4b4b-89a2-9d4aad252c54 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:37.560030 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-f5721f90-2c02-4b4b-89a2-9d4aad252c54 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:37.573081 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f5721f90-2c02-4b4b-89a2-9d4aad252c54 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:37.577998 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f5721f90-2c02-4b4b-89a2-9d4aad252c54 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:37.577998 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f5721f90-2c02-4b4b-89a2-9d4aad252c54 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:37.577998 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f5721f90-2c02-4b4b-89a2-9d4aad252c54 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:37.747516 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-7d825e0d-6877-4fb5-8025-854742dc2b82 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:37.756447 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-7d825e0d-6877-4fb5-8025-854742dc2b82 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2" status: 200 len: 1314 microversion: 2.1 time: 0.324530 Jun 07 08:40:37.757874 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 154/319] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:37 2022] GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:37.785838 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-f5721f90-2c02-4b4b-89a2-9d4aad252c54 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:37.794308 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-f5721f90-2c02-4b4b-89a2-9d4aad252c54 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1370 microversion: 2.1 time: 0.241498 Jun 07 08:40:37.801886 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 166/320] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:37 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1370 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:38.571883 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-5fa0cdd8-6386-4199-ba2e-587c6dadbec5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:38.572516 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-5fa0cdd8-6386-4199-ba2e-587c6dadbec5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:38.586182 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5fa0cdd8-6386-4199-ba2e-587c6dadbec5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:38.586860 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5fa0cdd8-6386-4199-ba2e-587c6dadbec5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:38.587814 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5fa0cdd8-6386-4199-ba2e-587c6dadbec5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:38.588409 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5fa0cdd8-6386-4199-ba2e-587c6dadbec5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:38.774639 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-74adc7a4-560b-4e44-ad66-7ea99fef5a76 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:38.775397 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-74adc7a4-560b-4e44-ad66-7ea99fef5a76 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: b45b99f6-03d4-4906-9ce3-db22d9cd9ec2] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:38.791771 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-74adc7a4-560b-4e44-ad66-7ea99fef5a76 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:38.793361 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-74adc7a4-560b-4e44-ad66-7ea99fef5a76 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:38.799202 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-74adc7a4-560b-4e44-ad66-7ea99fef5a76 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:38.800313 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-74adc7a4-560b-4e44-ad66-7ea99fef5a76 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:38.877177 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-5fa0cdd8-6386-4199-ba2e-587c6dadbec5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:38.893537 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-5fa0cdd8-6386-4199-ba2e-587c6dadbec5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:38.894040 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-5fa0cdd8-6386-4199-ba2e-587c6dadbec5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:38.898440 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-5fa0cdd8-6386-4199-ba2e-587c6dadbec5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1740 microversion: 2.20 time: 0.330502 Jun 07 08:40:38.902265 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 155/321] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:38 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1740 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:40:38.910581 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-8c880f93-47c5-44ce-8a34-5603a32d0b06 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:38.914399 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-8c880f93-47c5-44ce-8a34-5603a32d0b06 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:38.924019 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8c880f93-47c5-44ce-8a34-5603a32d0b06 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:38.925083 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8c880f93-47c5-44ce-8a34-5603a32d0b06 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:38.926249 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8c880f93-47c5-44ce-8a34-5603a32d0b06 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:38.926851 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8c880f93-47c5-44ce-8a34-5603a32d0b06 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:39.087697 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-74adc7a4-560b-4e44-ad66-7ea99fef5a76 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:39.097471 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-74adc7a4-560b-4e44-ad66-7ea99fef5a76 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2" status: 200 len: 1314 microversion: 2.1 time: 0.326850 Jun 07 08:40:39.107798 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 167/322] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:38 2022] GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:40:39.113428 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-eb6a165c-b064-4911-bcb9-9040bb7fbea6 req-4a01b198-c0b5-4fb6-a29a-0d5d06409547 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af1b519f-b5c9-4e6a-8413-8ce7ace3024c", "tag": "888115bf-712f-4cb1-b6a5-86649fc08594"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:40:39.127989 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-eb6a165c-b064-4911-bcb9-9040bb7fbea6 req-4a01b198-c0b5-4fb6-a29a-0d5d06409547 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:39.129997 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-eb6a165c-b064-4911-bcb9-9040bb7fbea6 req-4a01b198-c0b5-4fb6-a29a-0d5d06409547 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:39.149366 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-eb6a165c-b064-4911-bcb9-9040bb7fbea6 req-4a01b198-c0b5-4fb6-a29a-0d5d06409547 service nova] Creating event network-changed:888115bf-712f-4cb1-b6a5-86649fc08594 for instance af1b519f-b5c9-4e6a-8413-8ce7ace3024c on hv-cinder-74014 Jun 07 08:40:39.156979 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-eb6a165c-b064-4911-bcb9-9040bb7fbea6 req-4a01b198-c0b5-4fb6-a29a-0d5d06409547 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047633 Jun 07 08:40:39.158892 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 168/323] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:40:39.353995 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-8c880f93-47c5-44ce-8a34-5603a32d0b06 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:39.363596 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-8c880f93-47c5-44ce-8a34-5603a32d0b06 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1370 microversion: 2.1 time: 0.459318 Jun 07 08:40:39.364184 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 156/324] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:38 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1370 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:39.921643 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-4893b5fe-cf49-4da7-9850-8e139d2a5aaf tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:39.922632 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-4893b5fe-cf49-4da7-9850-8e139d2a5aaf tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:39.930224 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4893b5fe-cf49-4da7-9850-8e139d2a5aaf tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:39.933611 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4893b5fe-cf49-4da7-9850-8e139d2a5aaf tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:39.933611 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4893b5fe-cf49-4da7-9850-8e139d2a5aaf tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:39.933611 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4893b5fe-cf49-4da7-9850-8e139d2a5aaf tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:40.113996 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-4893b5fe-cf49-4da7-9850-8e139d2a5aaf tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:40.118051 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-e5dc2607-18c0-4f99-a7b3-94ae99c4ec98 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:40.122801 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-e5dc2607-18c0-4f99-a7b3-94ae99c4ec98 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: b45b99f6-03d4-4906-9ce3-db22d9cd9ec2] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:40.135442 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-4893b5fe-cf49-4da7-9850-8e139d2a5aaf tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:40.139787 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e5dc2607-18c0-4f99-a7b3-94ae99c4ec98 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:40.140764 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e5dc2607-18c0-4f99-a7b3-94ae99c4ec98 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:40.142351 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-4893b5fe-cf49-4da7-9850-8e139d2a5aaf tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:40.144161 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-4893b5fe-cf49-4da7-9850-8e139d2a5aaf tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1740 microversion: 2.20 time: 0.227025 Jun 07 08:40:40.144434 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e5dc2607-18c0-4f99-a7b3-94ae99c4ec98 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:40.145136 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e5dc2607-18c0-4f99-a7b3-94ae99c4ec98 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:40.147098 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 169/325] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:39 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1740 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:40:40.374021 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-e5dc2607-18c0-4f99-a7b3-94ae99c4ec98 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:40.385117 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-e5dc2607-18c0-4f99-a7b3-94ae99c4ec98 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2" status: 200 len: 1314 microversion: 2.1 time: 0.273782 Jun 07 08:40:40.386398 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 157/326] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:40 2022] GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:40.401042 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-f8182344-a98c-424d-aa00-f5770fc8c760 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:40.402076 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-f8182344-a98c-424d-aa00-f5770fc8c760 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:40.411233 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f8182344-a98c-424d-aa00-f5770fc8c760 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:40.411996 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f8182344-a98c-424d-aa00-f5770fc8c760 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:40.413165 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f8182344-a98c-424d-aa00-f5770fc8c760 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:40.414847 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f8182344-a98c-424d-aa00-f5770fc8c760 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:40.568052 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-f8182344-a98c-424d-aa00-f5770fc8c760 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:40.577419 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-f8182344-a98c-424d-aa00-f5770fc8c760 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1370 microversion: 2.1 time: 0.181445 Jun 07 08:40:40.581027 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 170/327] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:40 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:41.058721 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-9e40d527-8ed1-4b0d-8ddc-51a670435c9f req-5f117e1c-44ba-4a18-85f6-12ce64bd1778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b45b99f6-03d4-4906-9ce3-db22d9cd9ec2", "name": "network-vif-plugged", "status": "completed", "tag": "d2c10949-acf3-498a-a6f4-b0e5d95e9b2a"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:40:41.068008 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-9e40d527-8ed1-4b0d-8ddc-51a670435c9f req-5f117e1c-44ba-4a18-85f6-12ce64bd1778 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:41.068716 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-9e40d527-8ed1-4b0d-8ddc-51a670435c9f req-5f117e1c-44ba-4a18-85f6-12ce64bd1778 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:41.083217 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-9e40d527-8ed1-4b0d-8ddc-51a670435c9f req-5f117e1c-44ba-4a18-85f6-12ce64bd1778 service nova] Creating event network-vif-plugged:d2c10949-acf3-498a-a6f4-b0e5d95e9b2a for instance b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 on hv-cinder-74014 Jun 07 08:40:41.089564 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-9e40d527-8ed1-4b0d-8ddc-51a670435c9f req-5f117e1c-44ba-4a18-85f6-12ce64bd1778 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046227 Jun 07 08:40:41.093152 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 158/328] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:40:41.166184 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-2fd620c1-4f82-40ae-a33d-9024d1ddd05a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:41.167022 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-2fd620c1-4f82-40ae-a33d-9024d1ddd05a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:41.182271 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2fd620c1-4f82-40ae-a33d-9024d1ddd05a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:41.182754 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2fd620c1-4f82-40ae-a33d-9024d1ddd05a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:41.184042 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2fd620c1-4f82-40ae-a33d-9024d1ddd05a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:41.184487 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2fd620c1-4f82-40ae-a33d-9024d1ddd05a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:41.349715 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-2fd620c1-4f82-40ae-a33d-9024d1ddd05a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:41.360280 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-2fd620c1-4f82-40ae-a33d-9024d1ddd05a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:41.361840 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-2fd620c1-4f82-40ae-a33d-9024d1ddd05a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:41.363038 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-2fd620c1-4f82-40ae-a33d-9024d1ddd05a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1740 microversion: 2.20 time: 0.201488 Jun 07 08:40:41.363601 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 171/329] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:41 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:40:41.404841 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-7332974c-c2ec-438f-af27-8ba46c9fb8d3 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:41.405576 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-7332974c-c2ec-438f-af27-8ba46c9fb8d3 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: b45b99f6-03d4-4906-9ce3-db22d9cd9ec2] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:41.412005 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7332974c-c2ec-438f-af27-8ba46c9fb8d3 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:41.412449 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7332974c-c2ec-438f-af27-8ba46c9fb8d3 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:41.413291 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7332974c-c2ec-438f-af27-8ba46c9fb8d3 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:41.413728 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7332974c-c2ec-438f-af27-8ba46c9fb8d3 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:41.451285 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell0:SELECT=4 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:40:41.471900 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell0:SELECT=16 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:40:41.596090 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-8abf269d-952e-4327-b14a-faea589fd10e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:41.596935 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-8abf269d-952e-4327-b14a-faea589fd10e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:41.603870 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8abf269d-952e-4327-b14a-faea589fd10e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:41.604411 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8abf269d-952e-4327-b14a-faea589fd10e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:41.605236 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8abf269d-952e-4327-b14a-faea589fd10e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:41.605680 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8abf269d-952e-4327-b14a-faea589fd10e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:41.685869 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell0:SELECT=4 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:40:41.875380 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-7332974c-c2ec-438f-af27-8ba46c9fb8d3 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:41.898052 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-7332974c-c2ec-438f-af27-8ba46c9fb8d3 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2" status: 200 len: 1314 microversion: 2.1 time: 0.494112 Jun 07 08:40:41.902501 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 159/330] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:41 2022] GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:42.089320 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-8abf269d-952e-4327-b14a-faea589fd10e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:42.098629 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-8abf269d-952e-4327-b14a-faea589fd10e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1370 microversion: 2.1 time: 0.506150 Jun 07 08:40:42.100350 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 172/331] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:41 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1370 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:40:42.381187 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-063fde67-64d5-49ee-a38f-c6f965201b30 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:42.382786 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-063fde67-64d5-49ee-a38f-c6f965201b30 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:42.389277 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-063fde67-64d5-49ee-a38f-c6f965201b30 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:42.389806 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-063fde67-64d5-49ee-a38f-c6f965201b30 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:42.390702 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-063fde67-64d5-49ee-a38f-c6f965201b30 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:42.391160 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-063fde67-64d5-49ee-a38f-c6f965201b30 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:42.395521 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=100 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:40:42.551660 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-063fde67-64d5-49ee-a38f-c6f965201b30 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:42.561806 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-063fde67-64d5-49ee-a38f-c6f965201b30 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:42.563153 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-063fde67-64d5-49ee-a38f-c6f965201b30 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:42.565228 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-063fde67-64d5-49ee-a38f-c6f965201b30 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1740 microversion: 2.20 time: 0.187691 Jun 07 08:40:42.576864 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 160/332] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:42 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:40:42.924159 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-37a0fd67-ee9f-4057-848e-86bfd48c4370 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:42.925469 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-37a0fd67-ee9f-4057-848e-86bfd48c4370 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: b45b99f6-03d4-4906-9ce3-db22d9cd9ec2] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:42.947126 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-37a0fd67-ee9f-4057-848e-86bfd48c4370 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:42.948234 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-37a0fd67-ee9f-4057-848e-86bfd48c4370 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:42.949735 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-37a0fd67-ee9f-4057-848e-86bfd48c4370 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:42.950654 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-37a0fd67-ee9f-4057-848e-86bfd48c4370 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:43.117970 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-50429c69-87c6-4008-a33d-a409d9427759 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:43.118981 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-50429c69-87c6-4008-a33d-a409d9427759 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:43.130947 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-50429c69-87c6-4008-a33d-a409d9427759 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:43.133687 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-50429c69-87c6-4008-a33d-a409d9427759 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:43.135062 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-50429c69-87c6-4008-a33d-a409d9427759 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:43.137236 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-50429c69-87c6-4008-a33d-a409d9427759 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:43.153114 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-37a0fd67-ee9f-4057-848e-86bfd48c4370 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:43.168075 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-37a0fd67-ee9f-4057-848e-86bfd48c4370 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2" status: 200 len: 1314 microversion: 2.1 time: 0.248735 Jun 07 08:40:43.201423 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 173/333] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:42 2022] GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:43.360417 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-50429c69-87c6-4008-a33d-a409d9427759 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:43.372971 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-50429c69-87c6-4008-a33d-a409d9427759 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1370 microversion: 2.1 time: 0.258698 Jun 07 08:40:43.387876 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 161/334] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:43 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1370 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:43.586332 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-0f52f86e-b0bd-45fd-b0fc-9138bfd64966 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:43.587350 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-0f52f86e-b0bd-45fd-b0fc-9138bfd64966 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:43.598888 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0f52f86e-b0bd-45fd-b0fc-9138bfd64966 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:43.600514 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0f52f86e-b0bd-45fd-b0fc-9138bfd64966 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:43.603501 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0f52f86e-b0bd-45fd-b0fc-9138bfd64966 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:43.604543 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0f52f86e-b0bd-45fd-b0fc-9138bfd64966 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:43.810374 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-0f52f86e-b0bd-45fd-b0fc-9138bfd64966 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:43.820513 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-0f52f86e-b0bd-45fd-b0fc-9138bfd64966 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:43.822006 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-0f52f86e-b0bd-45fd-b0fc-9138bfd64966 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:43.823359 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-0f52f86e-b0bd-45fd-b0fc-9138bfd64966 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1740 microversion: 2.20 time: 0.241802 Jun 07 08:40:43.823926 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 174/335] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:43 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1740 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:40:44.186759 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-feb3c694-1ddb-48e0-b0b4-f12d78f6d606 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:44.188149 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-feb3c694-1ddb-48e0-b0b4-f12d78f6d606 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: b45b99f6-03d4-4906-9ce3-db22d9cd9ec2] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:44.195660 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-feb3c694-1ddb-48e0-b0b4-f12d78f6d606 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:44.196463 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-feb3c694-1ddb-48e0-b0b4-f12d78f6d606 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:44.197588 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-feb3c694-1ddb-48e0-b0b4-f12d78f6d606 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:44.198108 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-feb3c694-1ddb-48e0-b0b4-f12d78f6d606 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:44.374244 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-feb3c694-1ddb-48e0-b0b4-f12d78f6d606 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:44.391049 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-514b129c-a45b-4acf-a5f4-dbc3b3234380 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:44.393259 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-514b129c-a45b-4acf-a5f4-dbc3b3234380 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:44.398717 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-feb3c694-1ddb-48e0-b0b4-f12d78f6d606 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2" status: 200 len: 1314 microversion: 2.1 time: 0.215847 Jun 07 08:40:44.399958 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 162/336] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:44 2022] GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:44.413432 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-514b129c-a45b-4acf-a5f4-dbc3b3234380 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:44.414894 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-514b129c-a45b-4acf-a5f4-dbc3b3234380 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:44.414894 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-514b129c-a45b-4acf-a5f4-dbc3b3234380 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:44.415074 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-514b129c-a45b-4acf-a5f4-dbc3b3234380 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:44.568070 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-514b129c-a45b-4acf-a5f4-dbc3b3234380 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:44.580261 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-514b129c-a45b-4acf-a5f4-dbc3b3234380 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1370 microversion: 2.1 time: 0.192927 Jun 07 08:40:44.584229 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 175/337] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:44 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1370 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:44.842156 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-cf85b7a2-656a-4798-9b39-8394dcb5b5ce tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:44.843095 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-cf85b7a2-656a-4798-9b39-8394dcb5b5ce tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:44.849458 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-cf85b7a2-656a-4798-9b39-8394dcb5b5ce tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:44.850304 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-cf85b7a2-656a-4798-9b39-8394dcb5b5ce tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:44.851955 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-cf85b7a2-656a-4798-9b39-8394dcb5b5ce tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:44.852567 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-cf85b7a2-656a-4798-9b39-8394dcb5b5ce tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:45.028688 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-43b5337e-6f4c-415f-ab2e-24f1e1908c6b req-7cfa9e11-96d6-4ab6-aba5-1e9617011941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af1b519f-b5c9-4e6a-8413-8ce7ace3024c", "name": "network-vif-plugged", "status": "completed", "tag": "888115bf-712f-4cb1-b6a5-86649fc08594"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:40:45.046812 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-43b5337e-6f4c-415f-ab2e-24f1e1908c6b req-7cfa9e11-96d6-4ab6-aba5-1e9617011941 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:45.047275 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-43b5337e-6f4c-415f-ab2e-24f1e1908c6b req-7cfa9e11-96d6-4ab6-aba5-1e9617011941 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:45.056921 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-cf85b7a2-656a-4798-9b39-8394dcb5b5ce tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:45.068926 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-cf85b7a2-656a-4798-9b39-8394dcb5b5ce tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:45.072625 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-cf85b7a2-656a-4798-9b39-8394dcb5b5ce tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:45.073870 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-cf85b7a2-656a-4798-9b39-8394dcb5b5ce tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1740 microversion: 2.20 time: 0.235574 Jun 07 08:40:45.081824 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-43b5337e-6f4c-415f-ab2e-24f1e1908c6b req-7cfa9e11-96d6-4ab6-aba5-1e9617011941 service nova] Creating event network-vif-plugged:888115bf-712f-4cb1-b6a5-86649fc08594 for instance af1b519f-b5c9-4e6a-8413-8ce7ace3024c on hv-cinder-74014 Jun 07 08:40:45.085738 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 163/338] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:44 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1740 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:40:45.089143 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-43b5337e-6f4c-415f-ab2e-24f1e1908c6b req-7cfa9e11-96d6-4ab6-aba5-1e9617011941 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064069 Jun 07 08:40:45.094763 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 176/339] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:40:45.415680 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-2f92cbb7-c77c-4bc2-8acb-568daa22f619 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:45.416498 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-2f92cbb7-c77c-4bc2-8acb-568daa22f619 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: b45b99f6-03d4-4906-9ce3-db22d9cd9ec2] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:45.423196 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2f92cbb7-c77c-4bc2-8acb-568daa22f619 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:45.423753 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2f92cbb7-c77c-4bc2-8acb-568daa22f619 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:45.424723 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2f92cbb7-c77c-4bc2-8acb-568daa22f619 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:45.425277 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2f92cbb7-c77c-4bc2-8acb-568daa22f619 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:45.598293 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-77ad358f-9c08-47f2-b863-4b9dbdee19c1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:45.599046 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-77ad358f-9c08-47f2-b863-4b9dbdee19c1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:45.606256 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-77ad358f-9c08-47f2-b863-4b9dbdee19c1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:45.606697 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-77ad358f-9c08-47f2-b863-4b9dbdee19c1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:45.607463 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-77ad358f-9c08-47f2-b863-4b9dbdee19c1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:45.607893 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-77ad358f-9c08-47f2-b863-4b9dbdee19c1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:45.642347 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-2f92cbb7-c77c-4bc2-8acb-568daa22f619 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:45.651004 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-2f92cbb7-c77c-4bc2-8acb-568daa22f619 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2" status: 200 len: 1498 microversion: 2.1 time: 0.239076 Jun 07 08:40:45.662635 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 164/340] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:45 2022] GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 => generated 1498 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:45.781057 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-77ad358f-9c08-47f2-b863-4b9dbdee19c1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:45.789414 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-77ad358f-9c08-47f2-b863-4b9dbdee19c1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1370 microversion: 2.1 time: 0.195593 Jun 07 08:40:45.789977 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 177/341] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:45 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1370 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:46.092347 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-d3030643-9c8e-4550-a223-2548039dcbda tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:46.092963 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-d3030643-9c8e-4550-a223-2548039dcbda tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:46.099509 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d3030643-9c8e-4550-a223-2548039dcbda tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:46.099971 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d3030643-9c8e-4550-a223-2548039dcbda tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:46.100940 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d3030643-9c8e-4550-a223-2548039dcbda tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:46.106503 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d3030643-9c8e-4550-a223-2548039dcbda tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:46.300860 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-d3030643-9c8e-4550-a223-2548039dcbda tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:46.310826 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-d3030643-9c8e-4550-a223-2548039dcbda tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:46.312335 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-d3030643-9c8e-4550-a223-2548039dcbda tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:46.313750 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-d3030643-9c8e-4550-a223-2548039dcbda tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1740 microversion: 2.20 time: 0.225448 Jun 07 08:40:46.314595 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 165/342] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:46 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1740 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:40:46.806427 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-0df9095d-826c-4ab6-aa41-2b5739af72cf tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:46.807056 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-0df9095d-826c-4ab6-aa41-2b5739af72cf tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:46.813712 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0df9095d-826c-4ab6-aa41-2b5739af72cf tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:46.814476 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0df9095d-826c-4ab6-aa41-2b5739af72cf tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:46.814910 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0df9095d-826c-4ab6-aa41-2b5739af72cf tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:46.815338 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0df9095d-826c-4ab6-aa41-2b5739af72cf tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:46.951436 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-0df9095d-826c-4ab6-aa41-2b5739af72cf tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:46.959301 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-0df9095d-826c-4ab6-aa41-2b5739af72cf tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1370 microversion: 2.1 time: 0.157226 Jun 07 08:40:46.959974 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 178/343] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:46 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:47.186105 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-a3c382f9-5dc4-4b6d-8fd1-3d0c07b15bb9 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:47.186665 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-a3c382f9-5dc4-4b6d-8fd1-3d0c07b15bb9 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: b45b99f6-03d4-4906-9ce3-db22d9cd9ec2] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:47.192987 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a3c382f9-5dc4-4b6d-8fd1-3d0c07b15bb9 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:47.193735 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a3c382f9-5dc4-4b6d-8fd1-3d0c07b15bb9 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:47.195036 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a3c382f9-5dc4-4b6d-8fd1-3d0c07b15bb9 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:47.195467 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a3c382f9-5dc4-4b6d-8fd1-3d0c07b15bb9 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:47.223441 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-a3c382f9-5dc4-4b6d-8fd1-3d0c07b15bb9 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: b45b99f6-03d4-4906-9ce3-db22d9cd9ec2] Going to try to terminate instance {{(pid=129726) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 08:40:47.333078 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-328eea2b-26ba-4107-9cfe-f1dab95ef113 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:47.333866 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-328eea2b-26ba-4107-9cfe-f1dab95ef113 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:47.341324 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-328eea2b-26ba-4107-9cfe-f1dab95ef113 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:47.341771 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-328eea2b-26ba-4107-9cfe-f1dab95ef113 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:47.347333 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-328eea2b-26ba-4107-9cfe-f1dab95ef113 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:47.347333 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-328eea2b-26ba-4107-9cfe-f1dab95ef113 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:47.486750 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-328eea2b-26ba-4107-9cfe-f1dab95ef113 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:47.488062 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-a3c382f9-5dc4-4b6d-8fd1-3d0c07b15bb9 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2" status: 204 len: 0 microversion: 2.1 time: 0.305073 Jun 07 08:40:47.488664 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 166/344] 10.222.0.17 () {58 vars in 1238 bytes} [Tue Jun 7 08:40:47 2022] DELETE /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 08:40:47.498914 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-328eea2b-26ba-4107-9cfe-f1dab95ef113 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:47.500220 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-08a82247-9b06-42c9-864f-52e1d05aa8a2 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:47.500753 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-328eea2b-26ba-4107-9cfe-f1dab95ef113 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:47.501160 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-08a82247-9b06-42c9-864f-52e1d05aa8a2 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: b45b99f6-03d4-4906-9ce3-db22d9cd9ec2] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:47.502513 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-328eea2b-26ba-4107-9cfe-f1dab95ef113 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1740 microversion: 2.20 time: 0.173278 Jun 07 08:40:47.503558 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 179/345] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:47 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:40:47.508967 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-08a82247-9b06-42c9-864f-52e1d05aa8a2 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:47.509443 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-08a82247-9b06-42c9-864f-52e1d05aa8a2 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:47.510217 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-08a82247-9b06-42c9-864f-52e1d05aa8a2 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:47.510653 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-08a82247-9b06-42c9-864f-52e1d05aa8a2 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:47.676571 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-08a82247-9b06-42c9-864f-52e1d05aa8a2 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:47.687065 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-08a82247-9b06-42c9-864f-52e1d05aa8a2 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2" status: 200 len: 1504 microversion: 2.1 time: 0.191046 Jun 07 08:40:47.687648 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 167/346] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:47 2022] GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 => generated 1504 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:40:47.979103 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-e213f3b1-a0f8-4939-997a-af1f26c46619 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:47.979716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-e213f3b1-a0f8-4939-997a-af1f26c46619 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:47.986853 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e213f3b1-a0f8-4939-997a-af1f26c46619 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:47.987297 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e213f3b1-a0f8-4939-997a-af1f26c46619 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:47.988113 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e213f3b1-a0f8-4939-997a-af1f26c46619 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:47.988543 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e213f3b1-a0f8-4939-997a-af1f26c46619 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:48.004906 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=100 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:40:48.129316 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-e213f3b1-a0f8-4939-997a-af1f26c46619 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:48.137891 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-e213f3b1-a0f8-4939-997a-af1f26c46619 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1564 microversion: 2.1 time: 0.165050 Jun 07 08:40:48.138467 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 180/347] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:47 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:48.157186 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-b1e0dd3c-af91-403f-96ec-b1accfd0c5f0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:48.157949 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-b1e0dd3c-af91-403f-96ec-b1accfd0c5f0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:48.166654 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b1e0dd3c-af91-403f-96ec-b1accfd0c5f0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:48.166654 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b1e0dd3c-af91-403f-96ec-b1accfd0c5f0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:48.166654 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b1e0dd3c-af91-403f-96ec-b1accfd0c5f0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:48.166654 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b1e0dd3c-af91-403f-96ec-b1accfd0c5f0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:48.248740 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-b1e0dd3c-af91-403f-96ec-b1accfd0c5f0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095561 Jun 07 08:40:48.249372 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 168/348] 10.222.0.17 () {58 vars in 1274 bytes} [Tue Jun 7 08:40:48 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:40:48.529848 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-4191f9cb-5aad-4c1e-8489-84921a961857 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:48.530855 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-4191f9cb-5aad-4c1e-8489-84921a961857 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:48.539481 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4191f9cb-5aad-4c1e-8489-84921a961857 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:48.540266 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4191f9cb-5aad-4c1e-8489-84921a961857 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:48.541831 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4191f9cb-5aad-4c1e-8489-84921a961857 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:48.542628 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4191f9cb-5aad-4c1e-8489-84921a961857 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:48.684376 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-4191f9cb-5aad-4c1e-8489-84921a961857 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:48.692313 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-4191f9cb-5aad-4c1e-8489-84921a961857 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:48.693859 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-4191f9cb-5aad-4c1e-8489-84921a961857 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:48.695564 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-4191f9cb-5aad-4c1e-8489-84921a961857 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1740 microversion: 2.20 time: 0.173629 Jun 07 08:40:48.696569 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 181/349] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:48 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:40:48.706422 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-973edb87-e4be-457f-8f30-63f9256098a4 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:48.707296 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-973edb87-e4be-457f-8f30-63f9256098a4 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: b45b99f6-03d4-4906-9ce3-db22d9cd9ec2] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:48.718926 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-973edb87-e4be-457f-8f30-63f9256098a4 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:48.719651 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-973edb87-e4be-457f-8f30-63f9256098a4 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:48.720732 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-973edb87-e4be-457f-8f30-63f9256098a4 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:48.721423 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-973edb87-e4be-457f-8f30-63f9256098a4 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:48.911851 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-973edb87-e4be-457f-8f30-63f9256098a4 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:48.920169 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-973edb87-e4be-457f-8f30-63f9256098a4 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2" status: 200 len: 1504 microversion: 2.1 time: 0.218808 Jun 07 08:40:48.920843 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 169/350] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:48 2022] GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 => generated 1504 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:40:49.358134 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-ea84d1b8-5ae0-4c34-83eb-a2bba94e49a5 req-a770e116-51a7-4ed9-845b-352dab98565e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af1b519f-b5c9-4e6a-8413-8ce7ace3024c", "tag": "888115bf-712f-4cb1-b6a5-86649fc08594"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:40:49.395325 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-ea84d1b8-5ae0-4c34-83eb-a2bba94e49a5 req-a770e116-51a7-4ed9-845b-352dab98565e service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:49.396262 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-ea84d1b8-5ae0-4c34-83eb-a2bba94e49a5 req-a770e116-51a7-4ed9-845b-352dab98565e service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:49.420757 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-ea84d1b8-5ae0-4c34-83eb-a2bba94e49a5 req-a770e116-51a7-4ed9-845b-352dab98565e service nova] Creating event network-changed:888115bf-712f-4cb1-b6a5-86649fc08594 for instance af1b519f-b5c9-4e6a-8413-8ce7ace3024c on hv-cinder-74014 Jun 07 08:40:49.440248 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-ea84d1b8-5ae0-4c34-83eb-a2bba94e49a5 req-a770e116-51a7-4ed9-845b-352dab98565e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079796 Jun 07 08:40:49.441032 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 182/351] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:40:49.636868 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-a23b2458-ca90-4016-b6af-44b3dae70e3a tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:49.638629 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-a23b2458-ca90-4016-b6af-44b3dae70e3a tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:49.646865 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a23b2458-ca90-4016-b6af-44b3dae70e3a tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:49.649270 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a23b2458-ca90-4016-b6af-44b3dae70e3a tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:49.650834 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a23b2458-ca90-4016-b6af-44b3dae70e3a tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:49.652282 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a23b2458-ca90-4016-b6af-44b3dae70e3a tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:49.685044 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-a23b2458-ca90-4016-b6af-44b3dae70e3a tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7/ips" status: 200 len: 145 microversion: 2.1 time: 0.053272 Jun 07 08:40:49.686438 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 170/352] 10.222.0.17 () {58 vars in 1247 bytes} [Tue Jun 7 08:40:49 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7/ips => generated 145 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:40:49.716524 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-80e3d27e-e02f-4e5b-beca-997bc6e10334 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:49.717250 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-80e3d27e-e02f-4e5b-beca-997bc6e10334 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:49.723931 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-80e3d27e-e02f-4e5b-beca-997bc6e10334 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:49.724375 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-80e3d27e-e02f-4e5b-beca-997bc6e10334 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:49.725216 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-80e3d27e-e02f-4e5b-beca-997bc6e10334 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:49.725695 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-80e3d27e-e02f-4e5b-beca-997bc6e10334 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:49.938298 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-b67d6b57-d3e9-4341-bf95-504bb857b1a0 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:49.939966 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-b67d6b57-d3e9-4341-bf95-504bb857b1a0 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: b45b99f6-03d4-4906-9ce3-db22d9cd9ec2] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:49.950860 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b67d6b57-d3e9-4341-bf95-504bb857b1a0 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:49.951585 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b67d6b57-d3e9-4341-bf95-504bb857b1a0 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:49.952719 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b67d6b57-d3e9-4341-bf95-504bb857b1a0 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:49.953557 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b67d6b57-d3e9-4341-bf95-504bb857b1a0 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:50.207588 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-b67d6b57-d3e9-4341-bf95-504bb857b1a0 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:50.215676 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-b67d6b57-d3e9-4341-bf95-504bb857b1a0 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2" status: 200 len: 1504 microversion: 2.1 time: 0.282002 Jun 07 08:40:50.216645 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 171/353] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:49 2022] GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 => generated 1504 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:40:50.266094 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-80e3d27e-e02f-4e5b-beca-997bc6e10334 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:50.276928 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-80e3d27e-e02f-4e5b-beca-997bc6e10334 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:50.276928 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-80e3d27e-e02f-4e5b-beca-997bc6e10334 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:50.277512 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-80e3d27e-e02f-4e5b-beca-997bc6e10334 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1722 microversion: 2.20 time: 0.565158 Jun 07 08:40:50.278071 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 183/354] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:49 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1722 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:40:50.444197 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-f5732b2e-a4de-4714-98d1-c193a7fe8903 req-1366be3f-107e-4341-8c38-42fc55fdf0c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b45b99f6-03d4-4906-9ce3-db22d9cd9ec2", "name": "network-vif-deleted", "tag": "d2c10949-acf3-498a-a6f4-b0e5d95e9b2a"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:40:50.454627 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-f5732b2e-a4de-4714-98d1-c193a7fe8903 req-1366be3f-107e-4341-8c38-42fc55fdf0c5 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:50.455102 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-f5732b2e-a4de-4714-98d1-c193a7fe8903 req-1366be3f-107e-4341-8c38-42fc55fdf0c5 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:50.467093 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-f5732b2e-a4de-4714-98d1-c193a7fe8903 req-1366be3f-107e-4341-8c38-42fc55fdf0c5 service nova] Creating event network-vif-deleted:d2c10949-acf3-498a-a6f4-b0e5d95e9b2a for instance b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 on hv-cinder-74014 Jun 07 08:40:50.472203 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-f5732b2e-a4de-4714-98d1-c193a7fe8903 req-1366be3f-107e-4341-8c38-42fc55fdf0c5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031671 Jun 07 08:40:50.472798 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 172/355] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:40:51.233111 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-7111fe6a-5938-4b1e-add9-b186c45b2d33 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:51.233924 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-7111fe6a-5938-4b1e-add9-b186c45b2d33 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: b45b99f6-03d4-4906-9ce3-db22d9cd9ec2] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:51.236394 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_api:SELECT=94 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:40:51.241287 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7111fe6a-5938-4b1e-add9-b186c45b2d33 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:51.241735 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7111fe6a-5938-4b1e-add9-b186c45b2d33 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:51.242504 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7111fe6a-5938-4b1e-add9-b186c45b2d33 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:51.242940 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7111fe6a-5938-4b1e-add9-b186c45b2d33 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:51.302081 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-1ca19445-77bc-4895-ae07-658fe90f4796 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:51.302954 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-1ca19445-77bc-4895-ae07-658fe90f4796 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:51.311985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1ca19445-77bc-4895-ae07-658fe90f4796 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:51.311985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1ca19445-77bc-4895-ae07-658fe90f4796 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:51.313109 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1ca19445-77bc-4895-ae07-658fe90f4796 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:51.313934 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-7111fe6a-5938-4b1e-add9-b186c45b2d33 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:51.314237 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1ca19445-77bc-4895-ae07-658fe90f4796 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:51.324703 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-7111fe6a-5938-4b1e-add9-b186c45b2d33 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2" status: 200 len: 1462 microversion: 2.1 time: 0.095434 Jun 07 08:40:51.325850 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 184/356] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:51 2022] GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 => generated 1462 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:51.462318 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-1ca19445-77bc-4895-ae07-658fe90f4796 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:51.470379 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-1ca19445-77bc-4895-ae07-658fe90f4796 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:51.471887 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-1ca19445-77bc-4895-ae07-658fe90f4796 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:51.473078 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-1ca19445-77bc-4895-ae07-658fe90f4796 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1722 microversion: 2.20 time: 0.177342 Jun 07 08:40:51.473635 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 173/357] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:51 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:40:52.342156 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-a876c25d-b0b7-43d4-b52c-20fe047afdcf tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:52.342782 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-a876c25d-b0b7-43d4-b52c-20fe047afdcf tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: b45b99f6-03d4-4906-9ce3-db22d9cd9ec2] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:52.349334 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a876c25d-b0b7-43d4-b52c-20fe047afdcf tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:52.349792 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a876c25d-b0b7-43d4-b52c-20fe047afdcf tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:52.351061 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a876c25d-b0b7-43d4-b52c-20fe047afdcf tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:52.351685 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a876c25d-b0b7-43d4-b52c-20fe047afdcf tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:52.387454 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a876c25d-b0b7-43d4-b52c-20fe047afdcf tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:52.387903 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a876c25d-b0b7-43d4-b52c-20fe047afdcf tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:52.388665 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.objects.instance [None req-a876c25d-b0b7-43d4-b52c-20fe047afdcf tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lazy-loading 'fault' on Instance uuid b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 {{(pid=129725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:40:52.436414 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-a876c25d-b0b7-43d4-b52c-20fe047afdcf tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '489306774e664047a2a5629048455686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66894579564c8584bb7a4ff489ea22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:52.444431 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-a876c25d-b0b7-43d4-b52c-20fe047afdcf tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2" status: 200 len: 1304 microversion: 2.1 time: 0.106179 Jun 07 08:40:52.445038 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 185/358] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:52 2022] GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:40:52.492013 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-516f3370-3582-4ca1-818b-75d946b5cf42 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:52.505265 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-516f3370-3582-4ca1-818b-75d946b5cf42 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:52.512258 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-516f3370-3582-4ca1-818b-75d946b5cf42 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:52.512703 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-516f3370-3582-4ca1-818b-75d946b5cf42 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:52.513593 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-516f3370-3582-4ca1-818b-75d946b5cf42 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:52.514024 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-516f3370-3582-4ca1-818b-75d946b5cf42 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:52.712124 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-516f3370-3582-4ca1-818b-75d946b5cf42 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:52.720438 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-516f3370-3582-4ca1-818b-75d946b5cf42 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:52.721976 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-516f3370-3582-4ca1-818b-75d946b5cf42 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:52.723156 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-516f3370-3582-4ca1-818b-75d946b5cf42 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1725 microversion: 2.20 time: 0.235551 Jun 07 08:40:52.723699 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 174/359] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:52 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1725 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:40:52.743204 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-e5690644-dcf7-45f3-a9df-fd580e2a4c20 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd11eb86-22c5-4a53-ac80-4552d81f2b2e"}} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:40:52.744278 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-e5690644-dcf7-45f3-a9df-fd580e2a4c20 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:52.750538 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e5690644-dcf7-45f3-a9df-fd580e2a4c20 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:52.750998 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e5690644-dcf7-45f3-a9df-fd580e2a4c20 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:52.751770 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e5690644-dcf7-45f3-a9df-fd580e2a4c20 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:52.752209 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e5690644-dcf7-45f3-a9df-fd580e2a4c20 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:52.882336 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-3e9d30cf-97e7-44ad-a3c8-57dd552a43a0 req-41560e49-de5d-4e13-a7d2-d724be26124e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60630f0f-2831-479d-91fc-477b773635ad", "name": "network-vif-unplugged", "status": "completed", "tag": "87bcbdda-ce88-44b8-b537-66a7d29ac04f"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:40:52.892603 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-3e9d30cf-97e7-44ad-a3c8-57dd552a43a0 req-41560e49-de5d-4e13-a7d2-d724be26124e service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:52.893250 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-3e9d30cf-97e7-44ad-a3c8-57dd552a43a0 req-41560e49-de5d-4e13-a7d2-d724be26124e service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:52.906743 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-3e9d30cf-97e7-44ad-a3c8-57dd552a43a0 req-41560e49-de5d-4e13-a7d2-d724be26124e service nova] Creating event network-vif-unplugged:87bcbdda-ce88-44b8-b537-66a7d29ac04f for instance 60630f0f-2831-479d-91fc-477b773635ad on hv-cinder-74014 Jun 07 08:40:52.912296 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-3e9d30cf-97e7-44ad-a3c8-57dd552a43a0 req-41560e49-de5d-4e13-a7d2-d724be26124e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033814 Jun 07 08:40:52.912958 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 175/360] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:40:53.462088 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-aa82db96-ae2e-41ef-a169-e5532a649a69 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:53.462892 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-aa82db96-ae2e-41ef-a169-e5532a649a69 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] [instance: b45b99f6-03d4-4906-9ce3-db22d9cd9ec2] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:53.472178 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-aa82db96-ae2e-41ef-a169-e5532a649a69 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:53.476805 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-aa82db96-ae2e-41ef-a169-e5532a649a69 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:53.476805 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-aa82db96-ae2e-41ef-a169-e5532a649a69 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:53.476805 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-aa82db96-ae2e-41ef-a169-e5532a649a69 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:53.494389 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.wsgi [None req-aa82db96-ae2e-41ef-a169-e5532a649a69 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] HTTP exception thrown: Instance b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 could not be found. Jun 07 08:40:53.496206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-aa82db96-ae2e-41ef-a169-e5532a649a69 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Request method failure captured: Jun 07 08:40:53.496206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: request: GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 HTTP/1.1 Jun 07 08:40:53.496206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept: application/json Jun 07 08:40:53.496206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept-Encoding: identity Jun 07 08:40:53.496206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Connection: close Jun 07 08:40:53.496206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Length: 0 Jun 07 08:40:53.496206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Type: application/json Jun 07 08:40:53.496206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Host: 10.222.0.17 Jun 07 08:40:53.496206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Openstack-System-Scope: None Jun 07 08:40:53.496206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: User-Agent: python-urllib3/1.26.9 Jun 07 08:40:53.496206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Auth-Token: gAAAAABinw7TWpAv5OGgVIbLZRcMlcYgCaYfby6RMbhse5cwxHHd8pBFNF1mqLS4l4SdKnEoAIHm_mwpnHZX9saZ7gFsaKB0cJzBegh-PviAVqF1SEfA1BCZeeW2OXWyFaRss_FYaXKlqPJKXtTS-QhRiyMhTu4N_G89bElH-V0sNxbpgHwxu5c Jun 07 08:40:53.496206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Id: None Jun 07 08:40:53.496206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Name: None Jun 07 08:40:53.496206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Identity-Status: Confirmed Jun 07 08:40:53.496206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Is-Admin-Project: True Jun 07 08:40:53.496206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Id: default Jun 07 08:40:53.496206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Name: Default Jun 07 08:40:53.496206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Id: be66894579564c8584bb7a4ff489ea22 Jun 07 08:40:53.496206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Name: tempest-VolumesActionsTest-1950037314 Jun 07 08:40:53.496206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Role: reader,member Jun 07 08:40:53.496206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Roles: reader,member Jun 07 08:40:53.497863 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/be66894579564c8584bb7a4ff489ea22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/be66894579564c8584bb7a4ff489ea22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_be66894579564c8584bb7a4ff489ea22", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/be66894579564c8584bb7a4ff489ea22"}]}] Jun 07 08:40:53.497863 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant: tempest-VolumesActionsTest-1950037314 Jun 07 08:40:53.497863 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Id: be66894579564c8584bb7a4ff489ea22 Jun 07 08:40:53.497863 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Name: tempest-VolumesActionsTest-1950037314 Jun 07 08:40:53.497863 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User: tempest-VolumesActionsTest-1950037314-project Jun 07 08:40:53.497863 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Id: default Jun 07 08:40:53.497863 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Name: Default Jun 07 08:40:53.497863 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Id: 489306774e664047a2a5629048455686 Jun 07 08:40:53.497863 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Name: tempest-VolumesActionsTest-1950037314-project Jun 07 08:40:53.497863 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: method: > Jun 07 08:40:53.497863 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: exception: Instance b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 could not be found. Jun 07 08:40:53.497863 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: action_args: {'id': 'b45b99f6-03d4-4906-9ce3-db22d9cd9ec2'} Jun 07 08:40:53.498712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:40:53.498712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:40:53.498712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:40:53.498712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:40:53.498712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:40:53.498712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:40:53.498712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:40:53.498712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:40:53.498712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:40:53.498712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:40:53.498712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 could not be found. Jun 07 08:40:53.498712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:40:53.498712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:40:53.498712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:40:53.498712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:40:53.498712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:40:53.498712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:40:53.498712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:40:53.498712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:40:53.498712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:40:53.500473 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:40:53.500473 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 08:40:53.500473 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 08:40:53.500473 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:40:53.500473 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:40:53.500473 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:40:53.500473 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:40:53.500473 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 could not be found. Jun 07 08:40:53.500473 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:40:53.500473 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:40:53.500473 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:40:53.500473 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:40:53.500473 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:40:53.500473 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:40:53.500473 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:40:53.500473 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:40:53.500473 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 could not be found. Jun 07 08:40:53.500473 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:40:53.501831 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-aa82db96-ae2e-41ef-a169-e5532a649a69 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] Returning 404 to user: Instance b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 could not be found. {{(pid=129726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:40:53.501831 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-aa82db96-ae2e-41ef-a169-e5532a649a69 tempest-VolumesActionsTest-1950037314 tempest-VolumesActionsTest-1950037314-project] 10.222.0.17 "GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2" status: 404 len: 111 microversion: 2.1 time: 0.041247 Jun 07 08:40:53.501831 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 176/361] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:40:53 2022] GET /compute/v2.1/servers/b45b99f6-03d4-4906-9ce3-db22d9cd9ec2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 08:40:53.548043 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-b93a8b43-398d-4f7a-bcb2-80dfacc57355 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af821d37-774b-48d5-9874-8bba4c76f3a3"}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:40:53.549151 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-b93a8b43-398d-4f7a-bcb2-80dfacc57355 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:53.556449 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b93a8b43-398d-4f7a-bcb2-80dfacc57355 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:53.556891 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b93a8b43-398d-4f7a-bcb2-80dfacc57355 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:53.557703 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b93a8b43-398d-4f7a-bcb2-80dfacc57355 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:53.558187 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b93a8b43-398d-4f7a-bcb2-80dfacc57355 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:53.644613 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:40:53.974303 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-e5690644-dcf7-45f3-a9df-fd580e2a4c20 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "POST /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.234697 Jun 07 08:40:53.976819 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 186/362] 10.222.0.17 () {62 vars in 1363 bytes} [Tue Jun 7 08:40:52 2022] POST /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad/os-volume_attachments => generated 188 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 08:40:54.233104 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-625b51a9-04ac-4712-a785-42a0ec506138 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:40:54.233742 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-625b51a9-04ac-4712-a785-42a0ec506138 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:54.242480 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-625b51a9-04ac-4712-a785-42a0ec506138 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:54.244219 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-625b51a9-04ac-4712-a785-42a0ec506138 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:54.245050 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-625b51a9-04ac-4712-a785-42a0ec506138 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:54.245469 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-625b51a9-04ac-4712-a785-42a0ec506138 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:54.450865 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-b93a8b43-398d-4f7a-bcb2-80dfacc57355 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "POST /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.906636 Jun 07 08:40:54.451989 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 177/363] 10.222.0.17 () {60 vars in 1322 bytes} [Tue Jun 7 08:40:53 2022] POST /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7/os-volume_attachments => generated 194 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:40:54.515201 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-625b51a9-04ac-4712-a785-42a0ec506138 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "POST /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad/action" status: 202 len: 0 microversion: 2.20 time: 0.285880 Jun 07 08:40:54.516331 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 187/364] 10.222.0.17 () {62 vars in 1318 bytes} [Tue Jun 7 08:40:54 2022] POST /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 08:40:54.525402 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-b3b867fb-ff43-47c3-ae0e-265d6f6504f1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:54.526992 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-b3b867fb-ff43-47c3-ae0e-265d6f6504f1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:54.534931 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b3b867fb-ff43-47c3-ae0e-265d6f6504f1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:54.535602 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b3b867fb-ff43-47c3-ae0e-265d6f6504f1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:54.536386 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b3b867fb-ff43-47c3-ae0e-265d6f6504f1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:54.536819 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b3b867fb-ff43-47c3-ae0e-265d6f6504f1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:54.718473 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-b3b867fb-ff43-47c3-ae0e-265d6f6504f1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:54.731212 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-b3b867fb-ff43-47c3-ae0e-265d6f6504f1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:54.731212 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-b3b867fb-ff43-47c3-ae0e-265d6f6504f1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:54.731212 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-b3b867fb-ff43-47c3-ae0e-265d6f6504f1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1751 microversion: 2.20 time: 0.210168 Jun 07 08:40:54.731682 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 178/365] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:54 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1751 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:40:55.753739 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-a4daa58d-5f12-4785-95d9-e8b4541530f3 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:55.760034 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-a4daa58d-5f12-4785-95d9-e8b4541530f3 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:55.768633 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a4daa58d-5f12-4785-95d9-e8b4541530f3 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:55.769124 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a4daa58d-5f12-4785-95d9-e8b4541530f3 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:55.770060 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a4daa58d-5f12-4785-95d9-e8b4541530f3 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:55.770498 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a4daa58d-5f12-4785-95d9-e8b4541530f3 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:55.976389 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-a4daa58d-5f12-4785-95d9-e8b4541530f3 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:55.991012 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-a4daa58d-5f12-4785-95d9-e8b4541530f3 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:55.992970 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-a4daa58d-5f12-4785-95d9-e8b4541530f3 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:55.994666 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-a4daa58d-5f12-4785-95d9-e8b4541530f3 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1751 microversion: 2.20 time: 0.247845 Jun 07 08:40:55.995817 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 188/366] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:55 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1751 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:40:57.015272 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-231b01e3-7683-4af3-9dc2-bd1813383e76 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:57.016247 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-231b01e3-7683-4af3-9dc2-bd1813383e76 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:57.028902 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-231b01e3-7683-4af3-9dc2-bd1813383e76 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:57.029875 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-231b01e3-7683-4af3-9dc2-bd1813383e76 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:57.030878 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-231b01e3-7683-4af3-9dc2-bd1813383e76 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:57.031505 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-231b01e3-7683-4af3-9dc2-bd1813383e76 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:57.251901 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-231b01e3-7683-4af3-9dc2-bd1813383e76 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:57.264857 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-231b01e3-7683-4af3-9dc2-bd1813383e76 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:57.267921 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-231b01e3-7683-4af3-9dc2-bd1813383e76 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:57.272198 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-231b01e3-7683-4af3-9dc2-bd1813383e76 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1751 microversion: 2.20 time: 0.257815 Jun 07 08:40:57.272833 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 179/367] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:57 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1751 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:40:58.293719 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-5387a26e-c085-46bd-9d51-059f452e2e64 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:58.293719 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-5387a26e-c085-46bd-9d51-059f452e2e64 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:58.306287 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5387a26e-c085-46bd-9d51-059f452e2e64 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:58.306832 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5387a26e-c085-46bd-9d51-059f452e2e64 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:58.307648 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5387a26e-c085-46bd-9d51-059f452e2e64 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:58.308086 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5387a26e-c085-46bd-9d51-059f452e2e64 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:58.504170 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-5387a26e-c085-46bd-9d51-059f452e2e64 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:58.519463 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-5387a26e-c085-46bd-9d51-059f452e2e64 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:58.521256 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-5387a26e-c085-46bd-9d51-059f452e2e64 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:58.522585 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-5387a26e-c085-46bd-9d51-059f452e2e64 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1753 microversion: 2.20 time: 0.235525 Jun 07 08:40:58.524524 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 189/368] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:58 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1753 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:40:59.543766 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-dbeddb23-814e-40fc-b026-c13c09bf68cd tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:40:59.544441 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-dbeddb23-814e-40fc-b026-c13c09bf68cd tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:40:59.554765 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-dbeddb23-814e-40fc-b026-c13c09bf68cd tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:59.555772 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-dbeddb23-814e-40fc-b026-c13c09bf68cd tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:59.557380 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-dbeddb23-814e-40fc-b026-c13c09bf68cd tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:40:59.558160 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-dbeddb23-814e-40fc-b026-c13c09bf68cd tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:40:59.843930 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-dbeddb23-814e-40fc-b026-c13c09bf68cd tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:59.857918 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-dbeddb23-814e-40fc-b026-c13c09bf68cd tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:59.859936 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-dbeddb23-814e-40fc-b026-c13c09bf68cd tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:40:59.863214 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-dbeddb23-814e-40fc-b026-c13c09bf68cd tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1753 microversion: 2.20 time: 0.321583 Jun 07 08:40:59.864360 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 180/369] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:40:59 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1753 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:00.888059 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-9237dad8-e57a-41ab-9342-e6e631b405a0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:00.889671 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-9237dad8-e57a-41ab-9342-e6e631b405a0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:00.896978 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9237dad8-e57a-41ab-9342-e6e631b405a0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:00.900777 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9237dad8-e57a-41ab-9342-e6e631b405a0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:00.905380 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9237dad8-e57a-41ab-9342-e6e631b405a0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:00.905833 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9237dad8-e57a-41ab-9342-e6e631b405a0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:01.237153 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-9237dad8-e57a-41ab-9342-e6e631b405a0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:01.256158 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-9237dad8-e57a-41ab-9342-e6e631b405a0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:01.265922 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-9237dad8-e57a-41ab-9342-e6e631b405a0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:01.276278 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-9237dad8-e57a-41ab-9342-e6e631b405a0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1753 microversion: 2.20 time: 0.392498 Jun 07 08:41:01.277523 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 190/370] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:00 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1753 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:02.309880 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-11c0b003-0e8c-45b5-96df-40c52030c694 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:02.311609 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-11c0b003-0e8c-45b5-96df-40c52030c694 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:02.327685 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-11c0b003-0e8c-45b5-96df-40c52030c694 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:02.328390 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-11c0b003-0e8c-45b5-96df-40c52030c694 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:02.329368 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-11c0b003-0e8c-45b5-96df-40c52030c694 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:02.329951 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-11c0b003-0e8c-45b5-96df-40c52030c694 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:02.639281 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-11c0b003-0e8c-45b5-96df-40c52030c694 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:02.653983 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-11c0b003-0e8c-45b5-96df-40c52030c694 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:02.659860 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-11c0b003-0e8c-45b5-96df-40c52030c694 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:02.663673 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-11c0b003-0e8c-45b5-96df-40c52030c694 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1753 microversion: 2.20 time: 0.359888 Jun 07 08:41:02.664273 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 181/371] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:02 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1753 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:03.693434 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-2867b056-620e-4c03-a568-b6155db37e4f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:03.694689 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-2867b056-620e-4c03-a568-b6155db37e4f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:03.703184 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2867b056-620e-4c03-a568-b6155db37e4f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:03.707395 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2867b056-620e-4c03-a568-b6155db37e4f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:03.711070 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2867b056-620e-4c03-a568-b6155db37e4f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:03.713779 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2867b056-620e-4c03-a568-b6155db37e4f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:03.930702 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-2867b056-620e-4c03-a568-b6155db37e4f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:03.941963 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-2867b056-620e-4c03-a568-b6155db37e4f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:03.942259 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-2867b056-620e-4c03-a568-b6155db37e4f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:03.943686 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-2867b056-620e-4c03-a568-b6155db37e4f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1753 microversion: 2.20 time: 0.258822 Jun 07 08:41:03.945078 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 191/372] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:03 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1753 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:04.967430 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-9786af54-7262-4ce5-b56b-87eb8133d4fa tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:04.968190 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-9786af54-7262-4ce5-b56b-87eb8133d4fa tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:04.979030 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9786af54-7262-4ce5-b56b-87eb8133d4fa tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:04.982312 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9786af54-7262-4ce5-b56b-87eb8133d4fa tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:04.987147 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9786af54-7262-4ce5-b56b-87eb8133d4fa tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:04.987699 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9786af54-7262-4ce5-b56b-87eb8133d4fa tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:05.247429 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-9786af54-7262-4ce5-b56b-87eb8133d4fa tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:05.257223 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-9786af54-7262-4ce5-b56b-87eb8133d4fa tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:05.264423 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-9786af54-7262-4ce5-b56b-87eb8133d4fa tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:05.268708 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-9786af54-7262-4ce5-b56b-87eb8133d4fa tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1753 microversion: 2.20 time: 0.307993 Jun 07 08:41:05.269406 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 182/373] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:04 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1753 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:06.292262 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-8e32a1a3-3af3-40e5-a8a5-f607668e393a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:06.293827 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-8e32a1a3-3af3-40e5-a8a5-f607668e393a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:06.318350 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8e32a1a3-3af3-40e5-a8a5-f607668e393a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:06.325958 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8e32a1a3-3af3-40e5-a8a5-f607668e393a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:06.327632 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8e32a1a3-3af3-40e5-a8a5-f607668e393a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:06.330252 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8e32a1a3-3af3-40e5-a8a5-f607668e393a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:06.700120 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-8e32a1a3-3af3-40e5-a8a5-f607668e393a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:06.713584 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-8e32a1a3-3af3-40e5-a8a5-f607668e393a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:06.716621 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-8e32a1a3-3af3-40e5-a8a5-f607668e393a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:06.727106 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-8e32a1a3-3af3-40e5-a8a5-f607668e393a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1753 microversion: 2.20 time: 0.442838 Jun 07 08:41:06.728278 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 192/374] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:06 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1753 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:07.750905 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-07c7fde9-ccd2-48ea-a38d-5807f4b41c41 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:07.751690 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-07c7fde9-ccd2-48ea-a38d-5807f4b41c41 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:07.767220 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:41:07.771888 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-07c7fde9-ccd2-48ea-a38d-5807f4b41c41 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:07.774782 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-07c7fde9-ccd2-48ea-a38d-5807f4b41c41 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:07.779081 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-07c7fde9-ccd2-48ea-a38d-5807f4b41c41 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:07.780656 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-07c7fde9-ccd2-48ea-a38d-5807f4b41c41 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:07.894643 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-3024cebc-ab5d-4530-999d-4227a3251c7b tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:41:07.914607 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3024cebc-ab5d-4530-999d-4227a3251c7b tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:07.919678 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3024cebc-ab5d-4530-999d-4227a3251c7b tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:08.094411 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-07c7fde9-ccd2-48ea-a38d-5807f4b41c41 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:08.106298 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-07c7fde9-ccd2-48ea-a38d-5807f4b41c41 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:08.108061 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-07c7fde9-ccd2-48ea-a38d-5807f4b41c41 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:08.109548 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-07c7fde9-ccd2-48ea-a38d-5807f4b41c41 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1753 microversion: 2.20 time: 0.366470 Jun 07 08:41:08.110672 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 183/375] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:07 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1753 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:08.155319 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-3024cebc-ab5d-4530-999d-4227a3251c7b tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Going to try to stop instance {{(pid=129725) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 07 08:41:08.223441 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:41:08.421853 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-3024cebc-ab5d-4530-999d-4227a3251c7b tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "POST /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7/action" status: 202 len: 0 microversion: 2.1 time: 0.533405 Jun 07 08:41:08.425965 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 193/376] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jun 7 08:41:07 2022] POST /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7/action => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 08:41:08.431677 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-65f81c6e-88c2-4647-bdaf-2e248f849adf tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:08.432385 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-65f81c6e-88c2-4647-bdaf-2e248f849adf tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:08.439232 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-65f81c6e-88c2-4647-bdaf-2e248f849adf tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:08.439942 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-65f81c6e-88c2-4647-bdaf-2e248f849adf tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:08.440555 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-65f81c6e-88c2-4647-bdaf-2e248f849adf tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:08.441033 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-65f81c6e-88c2-4647-bdaf-2e248f849adf tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:08.621610 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-65f81c6e-88c2-4647-bdaf-2e248f849adf tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:08.630097 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-65f81c6e-88c2-4647-bdaf-2e248f849adf tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1721 microversion: 2.1 time: 0.203123 Jun 07 08:41:08.631092 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 184/377] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:08 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1721 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:41:09.129530 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-afabaeee-410a-4e4e-81e6-9dd0ec52c389 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:09.132466 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-afabaeee-410a-4e4e-81e6-9dd0ec52c389 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:09.142040 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-afabaeee-410a-4e4e-81e6-9dd0ec52c389 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:09.142040 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-afabaeee-410a-4e4e-81e6-9dd0ec52c389 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:09.142964 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-afabaeee-410a-4e4e-81e6-9dd0ec52c389 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:09.143557 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-afabaeee-410a-4e4e-81e6-9dd0ec52c389 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:09.466177 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-afabaeee-410a-4e4e-81e6-9dd0ec52c389 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:09.502897 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-afabaeee-410a-4e4e-81e6-9dd0ec52c389 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:09.505335 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-afabaeee-410a-4e4e-81e6-9dd0ec52c389 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:09.508790 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-afabaeee-410a-4e4e-81e6-9dd0ec52c389 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1753 microversion: 2.20 time: 0.384567 Jun 07 08:41:09.512294 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 194/378] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:09 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1753 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:09.648745 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-625d4c9d-0d0e-4ec3-98e5-5524779465eb tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:09.649401 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-625d4c9d-0d0e-4ec3-98e5-5524779465eb tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:09.668801 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-625d4c9d-0d0e-4ec3-98e5-5524779465eb tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:09.679402 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-625d4c9d-0d0e-4ec3-98e5-5524779465eb tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:09.679402 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-625d4c9d-0d0e-4ec3-98e5-5524779465eb tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:09.679402 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-625d4c9d-0d0e-4ec3-98e5-5524779465eb tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:09.964942 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-625d4c9d-0d0e-4ec3-98e5-5524779465eb tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:09.977180 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-625d4c9d-0d0e-4ec3-98e5-5524779465eb tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1721 microversion: 2.1 time: 0.332366 Jun 07 08:41:09.985723 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 185/379] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:09 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1721 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:10.539841 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-bdfa7d47-6bb3-434f-94c4-2e6a11dac38f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:10.540648 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-bdfa7d47-6bb3-434f-94c4-2e6a11dac38f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:10.568358 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-bdfa7d47-6bb3-434f-94c4-2e6a11dac38f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:10.572495 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-bdfa7d47-6bb3-434f-94c4-2e6a11dac38f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:10.576101 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-bdfa7d47-6bb3-434f-94c4-2e6a11dac38f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:10.576101 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-bdfa7d47-6bb3-434f-94c4-2e6a11dac38f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:10.952835 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-bdfa7d47-6bb3-434f-94c4-2e6a11dac38f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:10.963031 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-bdfa7d47-6bb3-434f-94c4-2e6a11dac38f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:10.964890 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-bdfa7d47-6bb3-434f-94c4-2e6a11dac38f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:10.966470 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-bdfa7d47-6bb3-434f-94c4-2e6a11dac38f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1753 microversion: 2.20 time: 0.440228 Jun 07 08:41:10.967596 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 195/380] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:10 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1753 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:10.998015 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-d8f7fb1b-89de-40fa-8833-62f36578cc9e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:10.998623 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-d8f7fb1b-89de-40fa-8833-62f36578cc9e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:11.019764 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d8f7fb1b-89de-40fa-8833-62f36578cc9e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:11.020284 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d8f7fb1b-89de-40fa-8833-62f36578cc9e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:11.023150 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d8f7fb1b-89de-40fa-8833-62f36578cc9e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:11.027136 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d8f7fb1b-89de-40fa-8833-62f36578cc9e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:11.358808 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-d8f7fb1b-89de-40fa-8833-62f36578cc9e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:11.375547 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-d8f7fb1b-89de-40fa-8833-62f36578cc9e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1721 microversion: 2.1 time: 0.382543 Jun 07 08:41:11.380810 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 186/381] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:10 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1721 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:12.002317 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-266019e4-bd8c-4506-ad77-95336c682be4 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:12.003216 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-266019e4-bd8c-4506-ad77-95336c682be4 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:12.022973 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-266019e4-bd8c-4506-ad77-95336c682be4 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:12.023727 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-266019e4-bd8c-4506-ad77-95336c682be4 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:12.024875 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-266019e4-bd8c-4506-ad77-95336c682be4 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:12.025616 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-266019e4-bd8c-4506-ad77-95336c682be4 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:12.395879 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-345c7840-e4c2-47fc-b877-15713edb7bfc tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:12.397382 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-345c7840-e4c2-47fc-b877-15713edb7bfc tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:12.406702 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-266019e4-bd8c-4506-ad77-95336c682be4 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:12.411160 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-345c7840-e4c2-47fc-b877-15713edb7bfc tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:12.419346 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-345c7840-e4c2-47fc-b877-15713edb7bfc tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:12.420572 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-345c7840-e4c2-47fc-b877-15713edb7bfc tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:12.421272 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-266019e4-bd8c-4506-ad77-95336c682be4 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:12.423282 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-266019e4-bd8c-4506-ad77-95336c682be4 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:12.423971 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-345c7840-e4c2-47fc-b877-15713edb7bfc tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:12.424610 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-266019e4-bd8c-4506-ad77-95336c682be4 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.432865 Jun 07 08:41:12.436897 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 196/382] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:11 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:12.927321 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-345c7840-e4c2-47fc-b877-15713edb7bfc tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:12.937353 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-345c7840-e4c2-47fc-b877-15713edb7bfc tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1721 microversion: 2.1 time: 0.545384 Jun 07 08:41:12.938156 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 187/383] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:12 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1721 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:13.457264 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-336cf6ae-d0fd-4c41-8a38-e11834aeb939 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:13.458069 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-336cf6ae-d0fd-4c41-8a38-e11834aeb939 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:13.471163 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-336cf6ae-d0fd-4c41-8a38-e11834aeb939 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:13.471994 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-336cf6ae-d0fd-4c41-8a38-e11834aeb939 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:13.473566 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-336cf6ae-d0fd-4c41-8a38-e11834aeb939 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:13.474393 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-336cf6ae-d0fd-4c41-8a38-e11834aeb939 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:13.630192 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-336cf6ae-d0fd-4c41-8a38-e11834aeb939 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:13.641607 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-336cf6ae-d0fd-4c41-8a38-e11834aeb939 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:13.643336 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-336cf6ae-d0fd-4c41-8a38-e11834aeb939 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:13.644792 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-336cf6ae-d0fd-4c41-8a38-e11834aeb939 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.192879 Jun 07 08:41:13.645772 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 197/384] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:13 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:13.976890 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-22640dac-6305-4480-96c4-fae8e728c897 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:13.981588 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-22640dac-6305-4480-96c4-fae8e728c897 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:13.994078 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-22640dac-6305-4480-96c4-fae8e728c897 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:13.994532 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-22640dac-6305-4480-96c4-fae8e728c897 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:13.995323 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-22640dac-6305-4480-96c4-fae8e728c897 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:13.995758 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-22640dac-6305-4480-96c4-fae8e728c897 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:14.278487 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-22640dac-6305-4480-96c4-fae8e728c897 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:14.290907 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-22640dac-6305-4480-96c4-fae8e728c897 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1721 microversion: 2.1 time: 0.339419 Jun 07 08:41:14.293746 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 188/385] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:13 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1721 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:14.664499 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-474513d8-1ebc-4044-961e-230e51b41a08 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:14.666308 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-474513d8-1ebc-4044-961e-230e51b41a08 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:14.678219 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-474513d8-1ebc-4044-961e-230e51b41a08 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:14.679417 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-474513d8-1ebc-4044-961e-230e51b41a08 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:14.681267 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-474513d8-1ebc-4044-961e-230e51b41a08 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:14.682282 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-474513d8-1ebc-4044-961e-230e51b41a08 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:15.018945 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-474513d8-1ebc-4044-961e-230e51b41a08 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:15.053769 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-474513d8-1ebc-4044-961e-230e51b41a08 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:15.055551 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-474513d8-1ebc-4044-961e-230e51b41a08 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:15.056767 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-474513d8-1ebc-4044-961e-230e51b41a08 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.396783 Jun 07 08:41:15.060675 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 198/386] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:14 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:15.314928 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-70aac8d9-7c8f-4472-b677-4f7cc4af9974 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:15.316346 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-70aac8d9-7c8f-4472-b677-4f7cc4af9974 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:15.333657 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-70aac8d9-7c8f-4472-b677-4f7cc4af9974 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:15.337483 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-70aac8d9-7c8f-4472-b677-4f7cc4af9974 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:15.338633 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-70aac8d9-7c8f-4472-b677-4f7cc4af9974 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:15.339255 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-70aac8d9-7c8f-4472-b677-4f7cc4af9974 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:15.719967 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-70aac8d9-7c8f-4472-b677-4f7cc4af9974 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:15.739534 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-70aac8d9-7c8f-4472-b677-4f7cc4af9974 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1721 microversion: 2.1 time: 0.429138 Jun 07 08:41:15.750996 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 189/387] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:15 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1721 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:41:16.080279 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-3f1d019f-69b3-44b5-a57d-69debc3407d1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:16.082409 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-3f1d019f-69b3-44b5-a57d-69debc3407d1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:16.105452 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3f1d019f-69b3-44b5-a57d-69debc3407d1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:16.106479 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3f1d019f-69b3-44b5-a57d-69debc3407d1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:16.107707 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3f1d019f-69b3-44b5-a57d-69debc3407d1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:16.108410 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3f1d019f-69b3-44b5-a57d-69debc3407d1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:16.758480 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-9b05457f-806e-4c9b-a3b5-928feedc8e84 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:16.771058 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-9b05457f-806e-4c9b-a3b5-928feedc8e84 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:16.801537 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9b05457f-806e-4c9b-a3b5-928feedc8e84 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:16.805773 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9b05457f-806e-4c9b-a3b5-928feedc8e84 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:16.806976 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9b05457f-806e-4c9b-a3b5-928feedc8e84 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:16.809607 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9b05457f-806e-4c9b-a3b5-928feedc8e84 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:16.902851 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-3f1d019f-69b3-44b5-a57d-69debc3407d1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:16.924607 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-3f1d019f-69b3-44b5-a57d-69debc3407d1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:16.926652 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-3f1d019f-69b3-44b5-a57d-69debc3407d1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:16.934641 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-3f1d019f-69b3-44b5-a57d-69debc3407d1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.859737 Jun 07 08:41:16.957026 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 199/388] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:16 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:17.287867 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-9b05457f-806e-4c9b-a3b5-928feedc8e84 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:17.307705 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-9b05457f-806e-4c9b-a3b5-928feedc8e84 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1721 microversion: 2.1 time: 0.549178 Jun 07 08:41:17.324886 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 190/389] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:16 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1721 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:17.971302 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-5a681fca-8cfe-435b-9c8d-d16d7ef07e2f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:17.972502 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-5a681fca-8cfe-435b-9c8d-d16d7ef07e2f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:17.987267 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5a681fca-8cfe-435b-9c8d-d16d7ef07e2f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:17.991311 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5a681fca-8cfe-435b-9c8d-d16d7ef07e2f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:17.992386 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5a681fca-8cfe-435b-9c8d-d16d7ef07e2f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:17.993091 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5a681fca-8cfe-435b-9c8d-d16d7ef07e2f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:18.272144 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-5a681fca-8cfe-435b-9c8d-d16d7ef07e2f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:18.293033 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-5a681fca-8cfe-435b-9c8d-d16d7ef07e2f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:18.294675 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-5a681fca-8cfe-435b-9c8d-d16d7ef07e2f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:18.298288 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-5a681fca-8cfe-435b-9c8d-d16d7ef07e2f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.332758 Jun 07 08:41:18.301303 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 200/390] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:17 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:18.332289 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-c06c9028-936f-49be-a8cd-6dde9e055fd2 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:18.332918 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-c06c9028-936f-49be-a8cd-6dde9e055fd2 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:18.354195 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c06c9028-936f-49be-a8cd-6dde9e055fd2 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:18.355414 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c06c9028-936f-49be-a8cd-6dde9e055fd2 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:18.359488 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c06c9028-936f-49be-a8cd-6dde9e055fd2 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:18.360065 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c06c9028-936f-49be-a8cd-6dde9e055fd2 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:18.697111 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-c06c9028-936f-49be-a8cd-6dde9e055fd2 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:18.708248 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-c06c9028-936f-49be-a8cd-6dde9e055fd2 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1721 microversion: 2.1 time: 0.379753 Jun 07 08:41:18.710200 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 191/391] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:18 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1721 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:19.327167 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-0a8fb4ee-c401-4ecb-aba0-9eec558e8b2b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:19.328482 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-0a8fb4ee-c401-4ecb-aba0-9eec558e8b2b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:19.336783 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0a8fb4ee-c401-4ecb-aba0-9eec558e8b2b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:19.338664 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0a8fb4ee-c401-4ecb-aba0-9eec558e8b2b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:19.338664 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0a8fb4ee-c401-4ecb-aba0-9eec558e8b2b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:19.338664 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0a8fb4ee-c401-4ecb-aba0-9eec558e8b2b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:19.553761 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-0a8fb4ee-c401-4ecb-aba0-9eec558e8b2b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:19.562722 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-0a8fb4ee-c401-4ecb-aba0-9eec558e8b2b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:19.564261 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-0a8fb4ee-c401-4ecb-aba0-9eec558e8b2b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:19.565531 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-0a8fb4ee-c401-4ecb-aba0-9eec558e8b2b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.242437 Jun 07 08:41:19.566157 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 201/392] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:19 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:19.728127 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-c4ed88cc-50c2-4a3e-858b-ebf0cf243c5c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:19.729299 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-c4ed88cc-50c2-4a3e-858b-ebf0cf243c5c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:19.739663 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c4ed88cc-50c2-4a3e-858b-ebf0cf243c5c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:19.740321 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c4ed88cc-50c2-4a3e-858b-ebf0cf243c5c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:19.749892 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c4ed88cc-50c2-4a3e-858b-ebf0cf243c5c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:19.749892 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c4ed88cc-50c2-4a3e-858b-ebf0cf243c5c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:19.921594 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-c4ed88cc-50c2-4a3e-858b-ebf0cf243c5c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:19.938101 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-c4ed88cc-50c2-4a3e-858b-ebf0cf243c5c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1721 microversion: 2.1 time: 0.214636 Jun 07 08:41:19.938932 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 192/393] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:19 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1721 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:41:20.592853 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-6ab03509-9e02-432e-8468-9ba4fe2a483b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:20.594168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-6ab03509-9e02-432e-8468-9ba4fe2a483b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:20.601505 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6ab03509-9e02-432e-8468-9ba4fe2a483b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:20.602214 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6ab03509-9e02-432e-8468-9ba4fe2a483b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:20.603194 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6ab03509-9e02-432e-8468-9ba4fe2a483b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:20.603789 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6ab03509-9e02-432e-8468-9ba4fe2a483b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:20.779766 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-6ab03509-9e02-432e-8468-9ba4fe2a483b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:20.793492 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-6ab03509-9e02-432e-8468-9ba4fe2a483b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:20.798414 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-6ab03509-9e02-432e-8468-9ba4fe2a483b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:20.799907 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-6ab03509-9e02-432e-8468-9ba4fe2a483b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.212555 Jun 07 08:41:20.812575 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 202/394] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:20 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:20.965935 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-88c60672-f586-4528-bb1c-b260c607f8ff tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:20.967202 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-88c60672-f586-4528-bb1c-b260c607f8ff tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:20.975360 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-88c60672-f586-4528-bb1c-b260c607f8ff tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:20.976174 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-88c60672-f586-4528-bb1c-b260c607f8ff tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:20.977235 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-88c60672-f586-4528-bb1c-b260c607f8ff tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:20.977842 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-88c60672-f586-4528-bb1c-b260c607f8ff tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:20.988291 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:41:21.330819 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-88c60672-f586-4528-bb1c-b260c607f8ff tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:21.352208 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-88c60672-f586-4528-bb1c-b260c607f8ff tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1721 microversion: 2.1 time: 0.389863 Jun 07 08:41:21.355626 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 193/395] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:20 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1721 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:21.818349 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-a138e5e2-09c1-4a53-a96f-ad658e99e18e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:21.820158 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-a138e5e2-09c1-4a53-a96f-ad658e99e18e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:21.826010 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_api:SELECT=42 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:41:21.828753 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a138e5e2-09c1-4a53-a96f-ad658e99e18e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:21.828753 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a138e5e2-09c1-4a53-a96f-ad658e99e18e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:21.828979 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a138e5e2-09c1-4a53-a96f-ad658e99e18e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:21.837556 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a138e5e2-09c1-4a53-a96f-ad658e99e18e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:22.093083 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-a138e5e2-09c1-4a53-a96f-ad658e99e18e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:22.192625 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-a138e5e2-09c1-4a53-a96f-ad658e99e18e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:22.210577 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-a138e5e2-09c1-4a53-a96f-ad658e99e18e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:22.216051 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-a138e5e2-09c1-4a53-a96f-ad658e99e18e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.399464 Jun 07 08:41:22.217391 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 203/396] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:21 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:41:22.377941 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-9b467f98-e746-4728-b14c-951303559bb7 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:22.379243 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-9b467f98-e746-4728-b14c-951303559bb7 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:22.404854 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9b467f98-e746-4728-b14c-951303559bb7 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:22.409311 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9b467f98-e746-4728-b14c-951303559bb7 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:22.409311 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9b467f98-e746-4728-b14c-951303559bb7 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:22.409311 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9b467f98-e746-4728-b14c-951303559bb7 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:22.664503 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-9b467f98-e746-4728-b14c-951303559bb7 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:22.679144 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-9b467f98-e746-4728-b14c-951303559bb7 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1721 microversion: 2.1 time: 0.305095 Jun 07 08:41:22.680364 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 194/397] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:22 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1721 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:23.238662 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-95707c73-6f1b-47c2-881b-89154c3a3250 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:23.239348 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-95707c73-6f1b-47c2-881b-89154c3a3250 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:23.252731 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-95707c73-6f1b-47c2-881b-89154c3a3250 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:23.252731 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-95707c73-6f1b-47c2-881b-89154c3a3250 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:23.252731 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-95707c73-6f1b-47c2-881b-89154c3a3250 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:23.252731 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-95707c73-6f1b-47c2-881b-89154c3a3250 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:23.424883 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-95707c73-6f1b-47c2-881b-89154c3a3250 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:23.434751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-95707c73-6f1b-47c2-881b-89154c3a3250 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:23.436100 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-95707c73-6f1b-47c2-881b-89154c3a3250 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:23.437397 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-95707c73-6f1b-47c2-881b-89154c3a3250 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.202834 Jun 07 08:41:23.437931 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 204/398] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:23 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:23.697139 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-8f9c1f5d-75f7-4f20-9016-6a3e6c2c1b56 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:23.697848 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-8f9c1f5d-75f7-4f20-9016-6a3e6c2c1b56 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:23.703972 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8f9c1f5d-75f7-4f20-9016-6a3e6c2c1b56 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:23.704407 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8f9c1f5d-75f7-4f20-9016-6a3e6c2c1b56 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:23.705193 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8f9c1f5d-75f7-4f20-9016-6a3e6c2c1b56 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:23.705845 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8f9c1f5d-75f7-4f20-9016-6a3e6c2c1b56 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:23.872675 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-8f9c1f5d-75f7-4f20-9016-6a3e6c2c1b56 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:23.881179 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-8f9c1f5d-75f7-4f20-9016-6a3e6c2c1b56 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1721 microversion: 2.1 time: 0.188287 Jun 07 08:41:23.881840 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 195/399] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:23 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:24.458171 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-0a42cbd0-7b79-4ab6-8775-bb10e07286d8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:24.460149 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-0a42cbd0-7b79-4ab6-8775-bb10e07286d8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:24.473653 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0a42cbd0-7b79-4ab6-8775-bb10e07286d8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:24.476752 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0a42cbd0-7b79-4ab6-8775-bb10e07286d8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:24.477802 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0a42cbd0-7b79-4ab6-8775-bb10e07286d8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:24.479712 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0a42cbd0-7b79-4ab6-8775-bb10e07286d8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:24.758048 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-0a42cbd0-7b79-4ab6-8775-bb10e07286d8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:24.771294 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-0a42cbd0-7b79-4ab6-8775-bb10e07286d8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:24.775944 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-0a42cbd0-7b79-4ab6-8775-bb10e07286d8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:24.775944 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-0a42cbd0-7b79-4ab6-8775-bb10e07286d8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.321877 Jun 07 08:41:24.794400 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 205/400] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:24 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:24.900520 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-eeab76df-9f3b-4aa1-9ab8-4a56c0198bfb tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:24.901183 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-eeab76df-9f3b-4aa1-9ab8-4a56c0198bfb tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:24.907916 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-eeab76df-9f3b-4aa1-9ab8-4a56c0198bfb tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:24.908374 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-eeab76df-9f3b-4aa1-9ab8-4a56c0198bfb tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:24.909210 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-eeab76df-9f3b-4aa1-9ab8-4a56c0198bfb tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:24.909653 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-eeab76df-9f3b-4aa1-9ab8-4a56c0198bfb tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:25.149840 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-eeab76df-9f3b-4aa1-9ab8-4a56c0198bfb tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:25.160388 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-eeab76df-9f3b-4aa1-9ab8-4a56c0198bfb tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1721 microversion: 2.1 time: 0.265576 Jun 07 08:41:25.163678 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 196/401] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:24 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1721 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:25.804800 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-7ee6d29e-db9e-4e0e-b7fb-d3b4b7955f1d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:25.805572 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-7ee6d29e-db9e-4e0e-b7fb-d3b4b7955f1d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:25.821605 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7ee6d29e-db9e-4e0e-b7fb-d3b4b7955f1d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:25.822068 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7ee6d29e-db9e-4e0e-b7fb-d3b4b7955f1d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:25.824012 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7ee6d29e-db9e-4e0e-b7fb-d3b4b7955f1d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:25.824012 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7ee6d29e-db9e-4e0e-b7fb-d3b4b7955f1d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:26.075454 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-7ee6d29e-db9e-4e0e-b7fb-d3b4b7955f1d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:26.085076 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-7ee6d29e-db9e-4e0e-b7fb-d3b4b7955f1d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:26.086597 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-7ee6d29e-db9e-4e0e-b7fb-d3b4b7955f1d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:26.087977 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-7ee6d29e-db9e-4e0e-b7fb-d3b4b7955f1d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.296425 Jun 07 08:41:26.088789 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 206/402] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:25 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:26.190994 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-498492b5-d851-4e2c-b4ae-3f9438de5d1b tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:26.192219 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-498492b5-d851-4e2c-b4ae-3f9438de5d1b tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:26.205339 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-498492b5-d851-4e2c-b4ae-3f9438de5d1b tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:26.207277 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-498492b5-d851-4e2c-b4ae-3f9438de5d1b tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:26.208264 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-498492b5-d851-4e2c-b4ae-3f9438de5d1b tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:26.209900 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-498492b5-d851-4e2c-b4ae-3f9438de5d1b tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:26.462322 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-498492b5-d851-4e2c-b4ae-3f9438de5d1b tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:26.474012 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-498492b5-d851-4e2c-b4ae-3f9438de5d1b tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1698 microversion: 2.1 time: 0.290424 Jun 07 08:41:26.475684 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 197/403] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:26 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1698 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:41:26.493786 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-ab381d8c-4497-4845-9ef8-0eb860cbd071 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:41:26.500864 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ab381d8c-4497-4845-9ef8-0eb860cbd071 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:26.501754 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ab381d8c-4497-4845-9ef8-0eb860cbd071 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:26.529729 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-ab381d8c-4497-4845-9ef8-0eb860cbd071 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Going to try to start instance {{(pid=129725) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 07 08:41:26.734056 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-ab381d8c-4497-4845-9ef8-0eb860cbd071 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "POST /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7/action" status: 202 len: 0 microversion: 2.1 time: 0.244014 Jun 07 08:41:26.736082 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 207/404] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jun 7 08:41:26 2022] POST /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 08:41:26.744256 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-17b49f15-8a23-4ff1-a9a3-293979499fcf tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:26.744770 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-17b49f15-8a23-4ff1-a9a3-293979499fcf tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:26.752705 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-17b49f15-8a23-4ff1-a9a3-293979499fcf tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:26.753486 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-17b49f15-8a23-4ff1-a9a3-293979499fcf tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:26.754474 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-17b49f15-8a23-4ff1-a9a3-293979499fcf tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:26.755911 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-17b49f15-8a23-4ff1-a9a3-293979499fcf tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:26.952860 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-17b49f15-8a23-4ff1-a9a3-293979499fcf tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:26.975329 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-17b49f15-8a23-4ff1-a9a3-293979499fcf tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1707 microversion: 2.1 time: 0.235435 Jun 07 08:41:26.977904 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 198/405] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:26 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1707 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:27.108704 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-b0ddce5d-33a0-4fdc-acb6-0b1324dfe68f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:27.109519 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-b0ddce5d-33a0-4fdc-acb6-0b1324dfe68f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:27.120989 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b0ddce5d-33a0-4fdc-acb6-0b1324dfe68f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:27.121540 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b0ddce5d-33a0-4fdc-acb6-0b1324dfe68f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:27.122423 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b0ddce5d-33a0-4fdc-acb6-0b1324dfe68f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:27.122934 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b0ddce5d-33a0-4fdc-acb6-0b1324dfe68f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:27.203789 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:41:27.420472 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-b0ddce5d-33a0-4fdc-acb6-0b1324dfe68f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:27.431418 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-b0ddce5d-33a0-4fdc-acb6-0b1324dfe68f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:27.433761 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-b0ddce5d-33a0-4fdc-acb6-0b1324dfe68f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:27.435146 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-b0ddce5d-33a0-4fdc-acb6-0b1324dfe68f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.331274 Jun 07 08:41:27.435877 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 208/406] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:27 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:27.994690 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-101a7252-a6ce-42d1-8d33-f19d29059b5c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:27.995303 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-101a7252-a6ce-42d1-8d33-f19d29059b5c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:28.001973 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-101a7252-a6ce-42d1-8d33-f19d29059b5c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:28.002350 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-101a7252-a6ce-42d1-8d33-f19d29059b5c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:28.003118 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-101a7252-a6ce-42d1-8d33-f19d29059b5c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:28.003552 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-101a7252-a6ce-42d1-8d33-f19d29059b5c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:28.144142 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-101a7252-a6ce-42d1-8d33-f19d29059b5c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:28.152925 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-101a7252-a6ce-42d1-8d33-f19d29059b5c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1707 microversion: 2.1 time: 0.162740 Jun 07 08:41:28.153558 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 199/407] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:27 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1707 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:28.454729 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-111a74b1-4c2d-41e6-a517-a408fe70f33f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:28.456039 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-111a74b1-4c2d-41e6-a517-a408fe70f33f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:28.463843 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-111a74b1-4c2d-41e6-a517-a408fe70f33f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:28.464828 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-111a74b1-4c2d-41e6-a517-a408fe70f33f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:28.465810 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-111a74b1-4c2d-41e6-a517-a408fe70f33f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:28.466409 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-111a74b1-4c2d-41e6-a517-a408fe70f33f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:28.655290 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-111a74b1-4c2d-41e6-a517-a408fe70f33f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:28.669753 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-111a74b1-4c2d-41e6-a517-a408fe70f33f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:28.671610 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-111a74b1-4c2d-41e6-a517-a408fe70f33f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:28.673637 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-111a74b1-4c2d-41e6-a517-a408fe70f33f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.222898 Jun 07 08:41:28.685963 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 209/408] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:28 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:29.205787 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-04a5220e-46de-463f-bd21-090a8f353a19 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:29.205787 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-04a5220e-46de-463f-bd21-090a8f353a19 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:29.205787 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-04a5220e-46de-463f-bd21-090a8f353a19 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:29.205787 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-04a5220e-46de-463f-bd21-090a8f353a19 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:29.207765 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-04a5220e-46de-463f-bd21-090a8f353a19 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:29.207765 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-04a5220e-46de-463f-bd21-090a8f353a19 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:29.372598 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-04a5220e-46de-463f-bd21-090a8f353a19 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:29.390343 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-04a5220e-46de-463f-bd21-090a8f353a19 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1707 microversion: 2.1 time: 0.222541 Jun 07 08:41:29.390925 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 200/409] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:29 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1707 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:29.693514 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-1f9220ff-7570-4a16-8741-38d62aad9e71 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:29.694159 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-1f9220ff-7570-4a16-8741-38d62aad9e71 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:29.702057 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1f9220ff-7570-4a16-8741-38d62aad9e71 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:29.702500 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1f9220ff-7570-4a16-8741-38d62aad9e71 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:29.703408 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1f9220ff-7570-4a16-8741-38d62aad9e71 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:29.703725 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1f9220ff-7570-4a16-8741-38d62aad9e71 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:29.879465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-1f9220ff-7570-4a16-8741-38d62aad9e71 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:29.889386 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-1f9220ff-7570-4a16-8741-38d62aad9e71 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:29.890940 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-1f9220ff-7570-4a16-8741-38d62aad9e71 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:29.892144 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-1f9220ff-7570-4a16-8741-38d62aad9e71 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.202900 Jun 07 08:41:29.892708 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 210/410] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:29 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:30.408556 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-9e163f9d-4cd4-4f52-aa10-b70724186f4d tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:30.410072 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-9e163f9d-4cd4-4f52-aa10-b70724186f4d tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:30.418001 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9e163f9d-4cd4-4f52-aa10-b70724186f4d tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:30.420522 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9e163f9d-4cd4-4f52-aa10-b70724186f4d tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:30.420522 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9e163f9d-4cd4-4f52-aa10-b70724186f4d tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:30.420522 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9e163f9d-4cd4-4f52-aa10-b70724186f4d tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:30.559144 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-9e163f9d-4cd4-4f52-aa10-b70724186f4d tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:30.568330 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-9e163f9d-4cd4-4f52-aa10-b70724186f4d tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1711 microversion: 2.1 time: 0.164268 Jun 07 08:41:30.568976 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 201/411] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:30 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1711 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:30.912230 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-84479a53-d261-48c1-92d5-42094ce7eaaf tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:30.914648 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-84479a53-d261-48c1-92d5-42094ce7eaaf tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:30.926968 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-84479a53-d261-48c1-92d5-42094ce7eaaf tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:30.928495 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-84479a53-d261-48c1-92d5-42094ce7eaaf tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:30.930851 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-84479a53-d261-48c1-92d5-42094ce7eaaf tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:30.931630 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-84479a53-d261-48c1-92d5-42094ce7eaaf tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:31.090669 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-133c410d-68f1-4976-91b5-7ab88b652936 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Action: 'create', calling method: .version_select at 0x7f7fecdc6c10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-342018110", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD45Lza/E4gOGg7PPrfv5a9Buube/XcEoDwT8MJhAfGAqMzLvQEgj+mz/tTOT9EkE8GrcPpL6H92Huwf4gSbKfPTH91D8CUuyrm5i/1uGsShe1NmKLwt2f2syo4iF+ed6g=="}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:41:31.120505 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-84479a53-d261-48c1-92d5-42094ce7eaaf tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:31.121992 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-133c410d-68f1-4976-91b5-7ab88b652936 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Getting quotas for project 1e49af480c6c4449b329b5e71904b17c. Resources: {'key_pairs'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 08:41:31.130781 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-84479a53-d261-48c1-92d5-42094ce7eaaf tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:31.132929 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-84479a53-d261-48c1-92d5-42094ce7eaaf tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:31.134553 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-84479a53-d261-48c1-92d5-42094ce7eaaf tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.227587 Jun 07 08:41:31.140728 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 211/412] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:30 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:31.143611 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-133c410d-68f1-4976-91b5-7ab88b652936 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Getting quotas for user 3bbc17dea01a41ad9ca61bc65ed59cf6 and project 1e49af480c6c4449b329b5e71904b17c. Resources: {'key_pairs'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 08:41:31.266923 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-133c410d-68f1-4976-91b5-7ab88b652936 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.180158 Jun 07 08:41:31.268433 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 202/413] 10.222.0.17 () {60 vars in 1158 bytes} [Tue Jun 7 08:41:31 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:41:31.385189 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-2850242c-0015-4472-ac80-70a32e82a8ed tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-237184099", "imageRef": "d0556ff8-e7fd-46d0-84fb-b24f01ecad46", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-342018110", "networks": [{"uuid": "ffaf9865-9fe0-421b-9922-64b4aa26d3fd"}]}} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:41:32.160195 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-47678e8a-736f-41b2-b2a3-b7761b0cdf9b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:32.161555 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-47678e8a-736f-41b2-b2a3-b7761b0cdf9b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:32.180952 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-47678e8a-736f-41b2-b2a3-b7761b0cdf9b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:32.181545 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-47678e8a-736f-41b2-b2a3-b7761b0cdf9b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:32.182427 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-47678e8a-736f-41b2-b2a3-b7761b0cdf9b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:32.183688 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-47678e8a-736f-41b2-b2a3-b7761b0cdf9b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:32.347871 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-47678e8a-736f-41b2-b2a3-b7761b0cdf9b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:32.358222 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-47678e8a-736f-41b2-b2a3-b7761b0cdf9b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:32.360159 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-47678e8a-736f-41b2-b2a3-b7761b0cdf9b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:32.360881 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-47678e8a-736f-41b2-b2a3-b7761b0cdf9b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.206192 Jun 07 08:41:32.371997 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 203/414] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:32 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:41:33.379753 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-9015832a-6000-4acd-a37e-dcde6f911591 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:33.380476 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-9015832a-6000-4acd-a37e-dcde6f911591 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:33.387858 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9015832a-6000-4acd-a37e-dcde6f911591 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:33.388339 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9015832a-6000-4acd-a37e-dcde6f911591 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:33.389185 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9015832a-6000-4acd-a37e-dcde6f911591 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:33.389620 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9015832a-6000-4acd-a37e-dcde6f911591 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:33.555800 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-9015832a-6000-4acd-a37e-dcde6f911591 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:33.568186 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-9015832a-6000-4acd-a37e-dcde6f911591 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:33.571077 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-9015832a-6000-4acd-a37e-dcde6f911591 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:33.571434 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-9015832a-6000-4acd-a37e-dcde6f911591 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.195732 Jun 07 08:41:33.572505 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 204/415] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:33 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:41:34.592311 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-57283aaf-0f90-4835-a0e7-27abc5127a38 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:34.593276 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-57283aaf-0f90-4835-a0e7-27abc5127a38 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:34.600171 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-57283aaf-0f90-4835-a0e7-27abc5127a38 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:34.600702 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-57283aaf-0f90-4835-a0e7-27abc5127a38 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:34.602554 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-57283aaf-0f90-4835-a0e7-27abc5127a38 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:34.603070 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-57283aaf-0f90-4835-a0e7-27abc5127a38 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:34.793782 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.network.neutron [None req-2850242c-0015-4472-ac80-70a32e82a8ed tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] validate_networks() for [('ffaf9865-9fe0-421b-9922-64b4aa26d3fd', None, None, None, None, None)] {{(pid=129725) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 08:41:34.845312 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-57283aaf-0f90-4835-a0e7-27abc5127a38 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:34.855030 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-57283aaf-0f90-4835-a0e7-27abc5127a38 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:34.856936 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-57283aaf-0f90-4835-a0e7-27abc5127a38 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:34.858545 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-57283aaf-0f90-4835-a0e7-27abc5127a38 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.270108 Jun 07 08:41:34.859363 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 205/416] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:34 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:41:35.548521 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-2850242c-0015-4472-ac80-70a32e82a8ed tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Flavor limits 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 08:41:35.549411 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-2850242c-0015-4472-ac80-70a32e82a8ed tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Image limits 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 08:41:35.549411 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-2850242c-0015-4472-ac80-70a32e82a8ed tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Flavor pref 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 08:41:35.549827 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-2850242c-0015-4472-ac80-70a32e82a8ed tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Image pref 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 08:41:35.550235 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-2850242c-0015-4472-ac80-70a32e82a8ed tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 08:41:35.560947 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2850242c-0015-4472-ac80-70a32e82a8ed tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:35.561427 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2850242c-0015-4472-ac80-70a32e82a8ed tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:35.562222 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2850242c-0015-4472-ac80-70a32e82a8ed tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:35.562803 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2850242c-0015-4472-ac80-70a32e82a8ed tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:35.581088 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.quota [None req-2850242c-0015-4472-ac80-70a32e82a8ed tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Getting quotas for project 1e49af480c6c4449b329b5e71904b17c. Resources: {'ram', 'cores', 'instances'} {{(pid=129725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 08:41:35.586450 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.quota [None req-2850242c-0015-4472-ac80-70a32e82a8ed tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Getting quotas for user 3bbc17dea01a41ad9ca61bc65ed59cf6 and project 1e49af480c6c4449b329b5e71904b17c. Resources: {'ram', 'cores', 'instances'} {{(pid=129725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 08:41:35.604349 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-2850242c-0015-4472-ac80-70a32e82a8ed tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Going to run 1 instances... {{(pid=129725) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 08:41:35.606744 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-2850242c-0015-4472-ac80-70a32e82a8ed tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d0556ff8-e7fd-46d0-84fb-b24f01ecad46',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 08:41:35.727538 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-2850242c-0015-4472-ac80-70a32e82a8ed tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.346337 Jun 07 08:41:35.737401 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 212/417] 10.222.0.17 () {60 vars in 1146 bytes} [Tue Jun 7 08:41:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 4357 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 08:41:35.740523 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-88b3e1ca-caca-4f1d-a910-2b9ac4903f69 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:35.742834 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-88b3e1ca-caca-4f1d-a910-2b9ac4903f69 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:35.804552 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-88b3e1ca-caca-4f1d-a910-2b9ac4903f69 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:35.812625 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-88b3e1ca-caca-4f1d-a910-2b9ac4903f69 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1257 microversion: 2.1 time: 0.077420 Jun 07 08:41:35.814558 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 206/418] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:35 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1257 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:35.880562 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-c57e6a42-326d-4ddc-9604-cd40064b5572 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:35.889665 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-c57e6a42-326d-4ddc-9604-cd40064b5572 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:35.910292 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c57e6a42-326d-4ddc-9604-cd40064b5572 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:35.910859 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c57e6a42-326d-4ddc-9604-cd40064b5572 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:35.911706 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c57e6a42-326d-4ddc-9604-cd40064b5572 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:35.912157 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c57e6a42-326d-4ddc-9604-cd40064b5572 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:36.109749 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-c57e6a42-326d-4ddc-9604-cd40064b5572 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:36.124514 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-c57e6a42-326d-4ddc-9604-cd40064b5572 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:36.126586 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-c57e6a42-326d-4ddc-9604-cd40064b5572 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:36.127842 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-c57e6a42-326d-4ddc-9604-cd40064b5572 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.251988 Jun 07 08:41:36.131774 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 213/419] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:35 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:36.167339 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-7ce71fde-e5d4-4237-9c5e-3a83c03333f5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09650d5e-d7fe-442f-ac94-0774fac75b96"}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:41:36.169023 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-7ce71fde-e5d4-4237-9c5e-3a83c03333f5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:36.181024 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7ce71fde-e5d4-4237-9c5e-3a83c03333f5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:36.182299 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7ce71fde-e5d4-4237-9c5e-3a83c03333f5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:36.184295 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7ce71fde-e5d4-4237-9c5e-3a83c03333f5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:36.185479 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7ce71fde-e5d4-4237-9c5e-3a83c03333f5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:36.831325 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-316e28a5-ce61-406e-921e-92319c757b4e tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:36.831925 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-316e28a5-ce61-406e-921e-92319c757b4e tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:36.915247 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-316e28a5-ce61-406e-921e-92319c757b4e tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:36.921922 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-316e28a5-ce61-406e-921e-92319c757b4e tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1257 microversion: 2.1 time: 0.094371 Jun 07 08:41:36.922481 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 214/420] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:36 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1257 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:37.150139 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-8cd68e7c-ca49-43a8-abd3-89003d781b83 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:37.150528 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-8cd68e7c-ca49-43a8-abd3-89003d781b83 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:37.158161 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8cd68e7c-ca49-43a8-abd3-89003d781b83 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:37.158572 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8cd68e7c-ca49-43a8-abd3-89003d781b83 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:37.159335 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8cd68e7c-ca49-43a8-abd3-89003d781b83 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:37.159769 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8cd68e7c-ca49-43a8-abd3-89003d781b83 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:37.302301 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-7ce71fde-e5d4-4237-9c5e-3a83c03333f5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "POST /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.142166 Jun 07 08:41:37.303462 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 207/421] 10.222.0.17 () {60 vars in 1322 bytes} [Tue Jun 7 08:41:36 2022] POST /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c/os-volume_attachments => generated 194 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:41:37.306832 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-8cd68e7c-ca49-43a8-abd3-89003d781b83 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:37.321159 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-8cd68e7c-ca49-43a8-abd3-89003d781b83 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:37.322999 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-8cd68e7c-ca49-43a8-abd3-89003d781b83 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:37.324971 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-8cd68e7c-ca49-43a8-abd3-89003d781b83 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.178847 Jun 07 08:41:37.326214 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 215/422] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:37 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:41:37.940553 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-2c1e9aff-85cf-43d1-b038-f2d4cb5d9d1f tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:37.941284 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-2c1e9aff-85cf-43d1-b038-f2d4cb5d9d1f tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:37.948576 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2c1e9aff-85cf-43d1-b038-f2d4cb5d9d1f tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:37.949057 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2c1e9aff-85cf-43d1-b038-f2d4cb5d9d1f tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:37.949846 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2c1e9aff-85cf-43d1-b038-f2d4cb5d9d1f tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:37.950289 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2c1e9aff-85cf-43d1-b038-f2d4cb5d9d1f tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:38.026240 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-2c1e9aff-85cf-43d1-b038-f2d4cb5d9d1f tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:38.037205 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-2c1e9aff-85cf-43d1-b038-f2d4cb5d9d1f tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1309 microversion: 2.1 time: 0.101284 Jun 07 08:41:38.037811 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 208/423] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:37 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:38.346308 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-cbbc9319-094f-4461-89e7-88a89636ae13 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:38.348058 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-cbbc9319-094f-4461-89e7-88a89636ae13 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:38.357602 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-cbbc9319-094f-4461-89e7-88a89636ae13 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:38.362823 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-cbbc9319-094f-4461-89e7-88a89636ae13 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:38.362823 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-cbbc9319-094f-4461-89e7-88a89636ae13 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:38.362823 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-cbbc9319-094f-4461-89e7-88a89636ae13 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:38.581149 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-cbbc9319-094f-4461-89e7-88a89636ae13 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:38.589917 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-cbbc9319-094f-4461-89e7-88a89636ae13 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:38.591733 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-cbbc9319-094f-4461-89e7-88a89636ae13 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:38.592923 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-cbbc9319-094f-4461-89e7-88a89636ae13 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.252013 Jun 07 08:41:38.601498 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 216/424] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:38 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:39.056020 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-9c735a7b-7092-4b6d-a721-09c72e06d378 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:39.056752 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-9c735a7b-7092-4b6d-a721-09c72e06d378 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:39.062696 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:41:39.066528 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9c735a7b-7092-4b6d-a721-09c72e06d378 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:39.067055 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9c735a7b-7092-4b6d-a721-09c72e06d378 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:39.067987 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9c735a7b-7092-4b6d-a721-09c72e06d378 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:39.068632 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9c735a7b-7092-4b6d-a721-09c72e06d378 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:39.249901 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-9c735a7b-7092-4b6d-a721-09c72e06d378 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:39.262137 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-9c735a7b-7092-4b6d-a721-09c72e06d378 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1357 microversion: 2.1 time: 0.210349 Jun 07 08:41:39.263470 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 209/425] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:39 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1357 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:39.622296 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-430235ad-a693-46e0-bc42-b35bf3fec2c6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:39.623132 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-430235ad-a693-46e0-bc42-b35bf3fec2c6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:39.648326 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-430235ad-a693-46e0-bc42-b35bf3fec2c6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:39.648795 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-430235ad-a693-46e0-bc42-b35bf3fec2c6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:39.659933 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-430235ad-a693-46e0-bc42-b35bf3fec2c6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:39.661113 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-430235ad-a693-46e0-bc42-b35bf3fec2c6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:40.011500 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-430235ad-a693-46e0-bc42-b35bf3fec2c6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:40.031586 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-430235ad-a693-46e0-bc42-b35bf3fec2c6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:40.034453 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-430235ad-a693-46e0-bc42-b35bf3fec2c6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:40.035927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-430235ad-a693-46e0-bc42-b35bf3fec2c6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.426759 Jun 07 08:41:40.036622 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 217/426] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:39 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:40.281436 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-305f289f-26c0-4221-a482-4d4042691a87 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:40.282638 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-305f289f-26c0-4221-a482-4d4042691a87 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:40.293752 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-305f289f-26c0-4221-a482-4d4042691a87 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:40.294754 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-305f289f-26c0-4221-a482-4d4042691a87 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:40.295749 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-305f289f-26c0-4221-a482-4d4042691a87 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:40.296187 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-305f289f-26c0-4221-a482-4d4042691a87 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:40.321020 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:41:40.535158 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-305f289f-26c0-4221-a482-4d4042691a87 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:40.565749 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-305f289f-26c0-4221-a482-4d4042691a87 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1357 microversion: 2.1 time: 0.285359 Jun 07 08:41:40.565749 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 210/427] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:40 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1357 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:40.698125 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-c4dca329-0e8e-4483-932d-9d3e6676e3c2 req-d7e70cc5-d055-4ec0-b7bb-1a5347f7bf85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b308a6f5-2c8d-45ad-ace4-9b623bfa76db", "tag": "97a8e43e-a795-4fed-8696-2a901df6519b"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:41:40.714953 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-c4dca329-0e8e-4483-932d-9d3e6676e3c2 req-d7e70cc5-d055-4ec0-b7bb-1a5347f7bf85 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:40.716253 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-c4dca329-0e8e-4483-932d-9d3e6676e3c2 req-d7e70cc5-d055-4ec0-b7bb-1a5347f7bf85 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:40.733991 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-c4dca329-0e8e-4483-932d-9d3e6676e3c2 req-d7e70cc5-d055-4ec0-b7bb-1a5347f7bf85 service nova] Creating event network-changed:97a8e43e-a795-4fed-8696-2a901df6519b for instance b308a6f5-2c8d-45ad-ace4-9b623bfa76db on hv-cinder-74014 Jun 07 08:41:40.740894 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-c4dca329-0e8e-4483-932d-9d3e6676e3c2 req-d7e70cc5-d055-4ec0-b7bb-1a5347f7bf85 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047181 Jun 07 08:41:40.745787 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 218/428] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:41:41.058967 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-71906370-88a8-49b5-8fe6-2725a13fb76b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:41.066569 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-71906370-88a8-49b5-8fe6-2725a13fb76b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:41.089092 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-71906370-88a8-49b5-8fe6-2725a13fb76b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:41.095955 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-71906370-88a8-49b5-8fe6-2725a13fb76b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:41.095955 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-71906370-88a8-49b5-8fe6-2725a13fb76b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:41.095955 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-71906370-88a8-49b5-8fe6-2725a13fb76b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:41.405792 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-71906370-88a8-49b5-8fe6-2725a13fb76b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:41.418638 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-71906370-88a8-49b5-8fe6-2725a13fb76b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:41.420544 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-71906370-88a8-49b5-8fe6-2725a13fb76b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:41.422135 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-71906370-88a8-49b5-8fe6-2725a13fb76b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.370143 Jun 07 08:41:41.423331 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 211/429] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:41 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:41.581996 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-8682a53e-376a-4c98-887a-d8745ad31067 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:41.582679 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-8682a53e-376a-4c98-887a-d8745ad31067 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:41.590561 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8682a53e-376a-4c98-887a-d8745ad31067 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:41.591285 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8682a53e-376a-4c98-887a-d8745ad31067 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:41.592414 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8682a53e-376a-4c98-887a-d8745ad31067 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:41.593026 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8682a53e-376a-4c98-887a-d8745ad31067 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:41.764882 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-8682a53e-376a-4c98-887a-d8745ad31067 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:41.773510 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-8682a53e-376a-4c98-887a-d8745ad31067 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1357 microversion: 2.1 time: 0.195745 Jun 07 08:41:41.774082 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 219/430] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:41 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1357 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:42.440554 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-49addca0-d2e5-4d82-b067-7484451c0e00 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:42.441176 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-49addca0-d2e5-4d82-b067-7484451c0e00 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:42.449163 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-49addca0-d2e5-4d82-b067-7484451c0e00 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:42.449611 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-49addca0-d2e5-4d82-b067-7484451c0e00 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:42.450377 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-49addca0-d2e5-4d82-b067-7484451c0e00 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:42.450811 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-49addca0-d2e5-4d82-b067-7484451c0e00 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:42.614055 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-49addca0-d2e5-4d82-b067-7484451c0e00 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:42.630894 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-49addca0-d2e5-4d82-b067-7484451c0e00 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:42.633685 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-49addca0-d2e5-4d82-b067-7484451c0e00 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:42.638960 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-49addca0-d2e5-4d82-b067-7484451c0e00 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.198329 Jun 07 08:41:42.638960 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 212/431] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:42 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:42.790897 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-066fd7c8-8b00-44e1-8685-f08f7c52e5ca tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:42.791552 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-066fd7c8-8b00-44e1-8685-f08f7c52e5ca tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:42.799053 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-066fd7c8-8b00-44e1-8685-f08f7c52e5ca tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:42.799540 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-066fd7c8-8b00-44e1-8685-f08f7c52e5ca tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:42.802198 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-066fd7c8-8b00-44e1-8685-f08f7c52e5ca tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:42.802198 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-066fd7c8-8b00-44e1-8685-f08f7c52e5ca tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:42.965413 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-066fd7c8-8b00-44e1-8685-f08f7c52e5ca tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:42.984019 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-066fd7c8-8b00-44e1-8685-f08f7c52e5ca tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1357 microversion: 2.1 time: 0.196868 Jun 07 08:41:42.984872 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 220/432] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:42 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1357 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:41:43.654500 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-b5391b31-0537-4d32-be61-d5d1617dd07d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:43.655155 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-b5391b31-0537-4d32-be61-d5d1617dd07d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:43.662347 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b5391b31-0537-4d32-be61-d5d1617dd07d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:43.662829 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b5391b31-0537-4d32-be61-d5d1617dd07d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:43.663583 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b5391b31-0537-4d32-be61-d5d1617dd07d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:43.664026 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b5391b31-0537-4d32-be61-d5d1617dd07d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:43.830808 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-b5391b31-0537-4d32-be61-d5d1617dd07d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:43.840859 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-b5391b31-0537-4d32-be61-d5d1617dd07d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:43.843087 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-b5391b31-0537-4d32-be61-d5d1617dd07d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:43.844660 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-b5391b31-0537-4d32-be61-d5d1617dd07d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.194057 Jun 07 08:41:43.845808 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 213/433] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:43 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:41:44.001680 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-655b5e97-807f-4dff-afb6-7ac8d533d3c8 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:44.002276 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-655b5e97-807f-4dff-afb6-7ac8d533d3c8 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:44.009381 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-655b5e97-807f-4dff-afb6-7ac8d533d3c8 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:44.009845 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-655b5e97-807f-4dff-afb6-7ac8d533d3c8 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:44.010624 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-655b5e97-807f-4dff-afb6-7ac8d533d3c8 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:44.011061 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-655b5e97-807f-4dff-afb6-7ac8d533d3c8 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:44.164153 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-655b5e97-807f-4dff-afb6-7ac8d533d3c8 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:44.172716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-655b5e97-807f-4dff-afb6-7ac8d533d3c8 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1357 microversion: 2.1 time: 0.174811 Jun 07 08:41:44.173356 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 221/434] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:43 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:44.864658 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-78ae0eef-dbef-479f-8476-f2630aff3b7f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:44.866133 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-78ae0eef-dbef-479f-8476-f2630aff3b7f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:44.881014 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-78ae0eef-dbef-479f-8476-f2630aff3b7f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:44.881554 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-78ae0eef-dbef-479f-8476-f2630aff3b7f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:44.882942 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-78ae0eef-dbef-479f-8476-f2630aff3b7f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:44.883382 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-78ae0eef-dbef-479f-8476-f2630aff3b7f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:45.138202 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-78ae0eef-dbef-479f-8476-f2630aff3b7f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:45.138202 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-78ae0eef-dbef-479f-8476-f2630aff3b7f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:45.138512 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-78ae0eef-dbef-479f-8476-f2630aff3b7f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:45.138512 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-78ae0eef-dbef-479f-8476-f2630aff3b7f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.201258 Jun 07 08:41:45.138512 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 214/435] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:44 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:45.189854 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-7cb7704b-f112-4adc-afae-0f743f97144d tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:45.191666 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-7cb7704b-f112-4adc-afae-0f743f97144d tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:45.213045 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7cb7704b-f112-4adc-afae-0f743f97144d tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:45.213933 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7cb7704b-f112-4adc-afae-0f743f97144d tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:45.214724 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7cb7704b-f112-4adc-afae-0f743f97144d tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:45.215159 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7cb7704b-f112-4adc-afae-0f743f97144d tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:45.408484 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-7cb7704b-f112-4adc-afae-0f743f97144d tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:45.420622 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-7cb7704b-f112-4adc-afae-0f743f97144d tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1357 microversion: 2.1 time: 0.233892 Jun 07 08:41:45.426232 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 222/436] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:45 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1357 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:46.155038 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-3e19ea01-5d9d-4516-afcf-dfca5770f8ab tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:46.155757 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-3e19ea01-5d9d-4516-afcf-dfca5770f8ab tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:46.158283 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell0:SELECT=6 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:41:46.165966 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3e19ea01-5d9d-4516-afcf-dfca5770f8ab tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:46.168296 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3e19ea01-5d9d-4516-afcf-dfca5770f8ab tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:46.168296 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3e19ea01-5d9d-4516-afcf-dfca5770f8ab tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:46.168296 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3e19ea01-5d9d-4516-afcf-dfca5770f8ab tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:46.318489 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-3e19ea01-5d9d-4516-afcf-dfca5770f8ab tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:46.338340 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-3e19ea01-5d9d-4516-afcf-dfca5770f8ab tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:46.340115 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-3e19ea01-5d9d-4516-afcf-dfca5770f8ab tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:46.341515 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-3e19ea01-5d9d-4516-afcf-dfca5770f8ab tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.190507 Jun 07 08:41:46.342419 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 215/437] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:46 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:46.440408 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-2838f911-0dc6-4bc1-9274-bee229daae26 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:46.441061 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-2838f911-0dc6-4bc1-9274-bee229daae26 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:46.443094 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell0:SELECT=2 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:41:46.449234 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2838f911-0dc6-4bc1-9274-bee229daae26 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:46.454190 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2838f911-0dc6-4bc1-9274-bee229daae26 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:46.454190 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2838f911-0dc6-4bc1-9274-bee229daae26 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:46.454190 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2838f911-0dc6-4bc1-9274-bee229daae26 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:46.606489 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-2838f911-0dc6-4bc1-9274-bee229daae26 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:46.615032 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-2838f911-0dc6-4bc1-9274-bee229daae26 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1357 microversion: 2.1 time: 0.178542 Jun 07 08:41:46.615616 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 223/438] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:46 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:47.359742 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-10fef790-3e15-4943-ab69-90d29e156902 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:47.360320 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-10fef790-3e15-4943-ab69-90d29e156902 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:47.367118 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-10fef790-3e15-4943-ab69-90d29e156902 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:47.367682 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-10fef790-3e15-4943-ab69-90d29e156902 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:47.368441 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-10fef790-3e15-4943-ab69-90d29e156902 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:47.368868 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-10fef790-3e15-4943-ab69-90d29e156902 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:47.508769 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-10fef790-3e15-4943-ab69-90d29e156902 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:47.517607 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-10fef790-3e15-4943-ab69-90d29e156902 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:47.519134 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-10fef790-3e15-4943-ab69-90d29e156902 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:47.520333 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-10fef790-3e15-4943-ab69-90d29e156902 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.164552 Jun 07 08:41:47.520890 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 216/439] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:47 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:47.633231 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-2f0557f1-46eb-4757-a495-ae6d7a71809f tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:47.633866 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-2f0557f1-46eb-4757-a495-ae6d7a71809f tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:47.635630 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell0:SELECT=8 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:41:47.641079 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2f0557f1-46eb-4757-a495-ae6d7a71809f tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:47.641534 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2f0557f1-46eb-4757-a495-ae6d7a71809f tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:47.642311 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2f0557f1-46eb-4757-a495-ae6d7a71809f tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:47.642748 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2f0557f1-46eb-4757-a495-ae6d7a71809f tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:47.791042 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-2f0557f1-46eb-4757-a495-ae6d7a71809f tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:47.795746 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-2f0557f1-46eb-4757-a495-ae6d7a71809f tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1357 microversion: 2.1 time: 0.167213 Jun 07 08:41:47.796325 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 224/440] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:47 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:48.540056 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-8a532ec4-18a4-4a7a-bddc-85ea4578d042 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:48.540651 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-8a532ec4-18a4-4a7a-bddc-85ea4578d042 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:48.547805 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8a532ec4-18a4-4a7a-bddc-85ea4578d042 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:48.547984 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8a532ec4-18a4-4a7a-bddc-85ea4578d042 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:48.548678 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8a532ec4-18a4-4a7a-bddc-85ea4578d042 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:48.549138 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8a532ec4-18a4-4a7a-bddc-85ea4578d042 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:48.682900 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-8a532ec4-18a4-4a7a-bddc-85ea4578d042 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:48.691471 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-8a532ec4-18a4-4a7a-bddc-85ea4578d042 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:48.692985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-8a532ec4-18a4-4a7a-bddc-85ea4578d042 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:48.694183 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-8a532ec4-18a4-4a7a-bddc-85ea4578d042 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.158750 Jun 07 08:41:48.694777 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 217/441] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:48 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:48.813341 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-5ff084fe-db8d-4e84-aa99-a10ba7f36f35 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:48.813953 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-5ff084fe-db8d-4e84-aa99-a10ba7f36f35 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:48.821249 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5ff084fe-db8d-4e84-aa99-a10ba7f36f35 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:48.821704 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5ff084fe-db8d-4e84-aa99-a10ba7f36f35 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:48.822487 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5ff084fe-db8d-4e84-aa99-a10ba7f36f35 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:48.822956 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5ff084fe-db8d-4e84-aa99-a10ba7f36f35 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:48.956631 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-5ff084fe-db8d-4e84-aa99-a10ba7f36f35 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:48.965134 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-5ff084fe-db8d-4e84-aa99-a10ba7f36f35 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1357 microversion: 2.1 time: 0.155683 Jun 07 08:41:48.965704 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 225/442] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:48 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:49.712029 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-89371789-4721-4bee-ad44-34c8ec0be2be tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:49.712667 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-89371789-4721-4bee-ad44-34c8ec0be2be tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:49.719288 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-89371789-4721-4bee-ad44-34c8ec0be2be tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:49.719739 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-89371789-4721-4bee-ad44-34c8ec0be2be tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:49.720499 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-89371789-4721-4bee-ad44-34c8ec0be2be tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:49.721005 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-89371789-4721-4bee-ad44-34c8ec0be2be tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:49.872456 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-89371789-4721-4bee-ad44-34c8ec0be2be tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:49.881584 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-89371789-4721-4bee-ad44-34c8ec0be2be tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:49.883085 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-89371789-4721-4bee-ad44-34c8ec0be2be tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:49.884304 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-89371789-4721-4bee-ad44-34c8ec0be2be tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.176448 Jun 07 08:41:49.884862 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 218/443] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:49 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:49.982264 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-663479dc-306c-44d9-b887-de2000b29471 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:49.982814 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-663479dc-306c-44d9-b887-de2000b29471 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:49.989468 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-663479dc-306c-44d9-b887-de2000b29471 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:49.989920 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-663479dc-306c-44d9-b887-de2000b29471 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:49.990688 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-663479dc-306c-44d9-b887-de2000b29471 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:49.991265 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-663479dc-306c-44d9-b887-de2000b29471 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:50.151175 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-663479dc-306c-44d9-b887-de2000b29471 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:50.151175 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-663479dc-306c-44d9-b887-de2000b29471 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1357 microversion: 2.1 time: 0.169398 Jun 07 08:41:50.151175 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 226/444] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:49 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:50.902680 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-b6c47901-f075-4619-b560-860ed2b7bc12 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:50.903298 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-b6c47901-f075-4619-b560-860ed2b7bc12 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:50.910188 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b6c47901-f075-4619-b560-860ed2b7bc12 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:50.910639 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b6c47901-f075-4619-b560-860ed2b7bc12 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:50.911414 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b6c47901-f075-4619-b560-860ed2b7bc12 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:50.911847 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b6c47901-f075-4619-b560-860ed2b7bc12 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:51.056746 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-b6c47901-f075-4619-b560-860ed2b7bc12 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:51.058650 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-b6c47901-f075-4619-b560-860ed2b7bc12 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:51.060138 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-b6c47901-f075-4619-b560-860ed2b7bc12 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:51.061349 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-b6c47901-f075-4619-b560-860ed2b7bc12 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.162710 Jun 07 08:41:51.061908 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 219/445] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:50 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:41:51.166564 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-89d1716f-8aad-44ca-8bab-f8afb5cebd9d tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:51.167193 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-89d1716f-8aad-44ca-8bab-f8afb5cebd9d tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:51.176878 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-89d1716f-8aad-44ca-8bab-f8afb5cebd9d tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:51.176878 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-89d1716f-8aad-44ca-8bab-f8afb5cebd9d tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:51.176878 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-89d1716f-8aad-44ca-8bab-f8afb5cebd9d tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:51.176878 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-89d1716f-8aad-44ca-8bab-f8afb5cebd9d tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:51.191980 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=100 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:41:51.341498 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-89d1716f-8aad-44ca-8bab-f8afb5cebd9d tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:51.349314 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-89d1716f-8aad-44ca-8bab-f8afb5cebd9d tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1357 microversion: 2.1 time: 0.187097 Jun 07 08:41:51.349902 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 227/446] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:51 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:52.079799 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-c1414dd1-0300-49d3-977b-b0d0e77bc99c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:52.080401 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-c1414dd1-0300-49d3-977b-b0d0e77bc99c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:52.087940 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c1414dd1-0300-49d3-977b-b0d0e77bc99c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:52.088382 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c1414dd1-0300-49d3-977b-b0d0e77bc99c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:52.089287 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c1414dd1-0300-49d3-977b-b0d0e77bc99c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:52.089821 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c1414dd1-0300-49d3-977b-b0d0e77bc99c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:52.226321 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-c1414dd1-0300-49d3-977b-b0d0e77bc99c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:52.235278 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-c1414dd1-0300-49d3-977b-b0d0e77bc99c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:52.236803 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-c1414dd1-0300-49d3-977b-b0d0e77bc99c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:52.238228 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-c1414dd1-0300-49d3-977b-b0d0e77bc99c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.162388 Jun 07 08:41:52.238794 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 220/447] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:52 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:52.365676 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-9b832eb4-14c5-4877-a0db-b2bc24db8369 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:52.366940 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-9b832eb4-14c5-4877-a0db-b2bc24db8369 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:52.371195 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:41:52.374034 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9b832eb4-14c5-4877-a0db-b2bc24db8369 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:52.374478 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9b832eb4-14c5-4877-a0db-b2bc24db8369 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:52.375242 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9b832eb4-14c5-4877-a0db-b2bc24db8369 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:52.375667 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9b832eb4-14c5-4877-a0db-b2bc24db8369 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:52.458165 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-7ad74be1-8add-4b70-aa07-131c7faa7ea1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:41:52.459202 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-7ad74be1-8add-4b70-aa07-131c7faa7ea1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:52.465617 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7ad74be1-8add-4b70-aa07-131c7faa7ea1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:52.466074 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7ad74be1-8add-4b70-aa07-131c7faa7ea1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:52.466847 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7ad74be1-8add-4b70-aa07-131c7faa7ea1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:52.467283 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7ad74be1-8add-4b70-aa07-131c7faa7ea1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:52.494072 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.objects.instance [None req-7ad74be1-8add-4b70-aa07-131c7faa7ea1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lazy-loading 'flavor' on Instance uuid af1b519f-b5c9-4e6a-8413-8ce7ace3024c {{(pid=129726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:41:52.515868 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-9b832eb4-14c5-4877-a0db-b2bc24db8369 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:52.524502 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-9b832eb4-14c5-4877-a0db-b2bc24db8369 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1357 microversion: 2.1 time: 0.162586 Jun 07 08:41:52.525093 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 228/448] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:52 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:52.810994 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-7ad74be1-8add-4b70-aa07-131c7faa7ea1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "POST /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c/action" status: 200 len: 32 microversion: 2.1 time: 0.356710 Jun 07 08:41:52.811611 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 221/449] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jun 7 08:41:52 2022] POST /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c/action => generated 32 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 07 08:41:52.821115 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-d7956824-87d5-42f4-a4d3-d00a142929c0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:52.821738 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-d7956824-87d5-42f4-a4d3-d00a142929c0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:52.828485 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d7956824-87d5-42f4-a4d3-d00a142929c0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:52.828943 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d7956824-87d5-42f4-a4d3-d00a142929c0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:52.829745 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d7956824-87d5-42f4-a4d3-d00a142929c0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:52.830249 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d7956824-87d5-42f4-a4d3-d00a142929c0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:53.000661 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-d7956824-87d5-42f4-a4d3-d00a142929c0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:53.012438 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-d7956824-87d5-42f4-a4d3-d00a142929c0 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1735 microversion: 2.1 time: 0.195616 Jun 07 08:41:53.014198 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 229/450] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:52 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1735 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:53.258856 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-28db4b88-f0dc-4dd9-8976-aec7573c338a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:53.260273 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-28db4b88-f0dc-4dd9-8976-aec7573c338a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:53.267275 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-28db4b88-f0dc-4dd9-8976-aec7573c338a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:53.267729 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-28db4b88-f0dc-4dd9-8976-aec7573c338a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:53.268541 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-28db4b88-f0dc-4dd9-8976-aec7573c338a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:53.269228 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-28db4b88-f0dc-4dd9-8976-aec7573c338a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:53.465665 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-28db4b88-f0dc-4dd9-8976-aec7573c338a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:53.486748 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-28db4b88-f0dc-4dd9-8976-aec7573c338a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:53.488245 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-28db4b88-f0dc-4dd9-8976-aec7573c338a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:53.489491 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-28db4b88-f0dc-4dd9-8976-aec7573c338a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.236689 Jun 07 08:41:53.490416 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 222/451] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:53 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:53.543008 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-087a342b-3de7-4a24-a570-aa0fcedee958 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:53.543753 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-087a342b-3de7-4a24-a570-aa0fcedee958 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:53.551233 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-087a342b-3de7-4a24-a570-aa0fcedee958 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:53.551897 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-087a342b-3de7-4a24-a570-aa0fcedee958 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:53.552904 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-087a342b-3de7-4a24-a570-aa0fcedee958 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:53.553409 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-087a342b-3de7-4a24-a570-aa0fcedee958 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:53.693063 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-087a342b-3de7-4a24-a570-aa0fcedee958 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:53.701293 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-087a342b-3de7-4a24-a570-aa0fcedee958 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1357 microversion: 2.1 time: 0.163135 Jun 07 08:41:53.701873 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 230/452] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:53 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:54.033220 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-6ea1a75c-7d34-49fe-abe7-fbcdbbfb0672 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:54.034310 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-6ea1a75c-7d34-49fe-abe7-fbcdbbfb0672 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:54.042078 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6ea1a75c-7d34-49fe-abe7-fbcdbbfb0672 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:54.042683 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6ea1a75c-7d34-49fe-abe7-fbcdbbfb0672 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:54.043993 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6ea1a75c-7d34-49fe-abe7-fbcdbbfb0672 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:54.044224 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6ea1a75c-7d34-49fe-abe7-fbcdbbfb0672 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:54.198775 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-6ea1a75c-7d34-49fe-abe7-fbcdbbfb0672 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:54.207244 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-6ea1a75c-7d34-49fe-abe7-fbcdbbfb0672 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1735 microversion: 2.1 time: 0.179234 Jun 07 08:41:54.207826 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 223/453] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:54 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:54.509095 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-b617d577-beca-42be-af28-a6cb158a7325 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:54.509701 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-b617d577-beca-42be-af28-a6cb158a7325 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:54.515874 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b617d577-beca-42be-af28-a6cb158a7325 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:54.516315 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b617d577-beca-42be-af28-a6cb158a7325 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:54.517112 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b617d577-beca-42be-af28-a6cb158a7325 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:54.517554 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b617d577-beca-42be-af28-a6cb158a7325 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:54.653011 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-b617d577-beca-42be-af28-a6cb158a7325 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:54.661975 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-b617d577-beca-42be-af28-a6cb158a7325 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:54.663646 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-b617d577-beca-42be-af28-a6cb158a7325 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:54.664881 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-b617d577-beca-42be-af28-a6cb158a7325 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.160293 Jun 07 08:41:54.665468 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 231/454] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:54 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:54.717857 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-45da4305-5e36-48a1-9ebd-b97e3cdc7a4c tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:54.718467 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-45da4305-5e36-48a1-9ebd-b97e3cdc7a4c tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:54.724983 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-45da4305-5e36-48a1-9ebd-b97e3cdc7a4c tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:54.725533 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-45da4305-5e36-48a1-9ebd-b97e3cdc7a4c tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:54.726294 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-45da4305-5e36-48a1-9ebd-b97e3cdc7a4c tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:54.726733 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-45da4305-5e36-48a1-9ebd-b97e3cdc7a4c tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:54.858150 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-45da4305-5e36-48a1-9ebd-b97e3cdc7a4c tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:54.865697 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-45da4305-5e36-48a1-9ebd-b97e3cdc7a4c tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1357 microversion: 2.1 time: 0.151689 Jun 07 08:41:54.866913 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 224/455] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:54 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:55.225416 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-4205d9c0-a4fa-40c6-9214-2b2a28331f6b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:55.226046 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-4205d9c0-a4fa-40c6-9214-2b2a28331f6b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:55.232550 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4205d9c0-a4fa-40c6-9214-2b2a28331f6b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:55.233051 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4205d9c0-a4fa-40c6-9214-2b2a28331f6b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:55.233836 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4205d9c0-a4fa-40c6-9214-2b2a28331f6b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:55.234278 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4205d9c0-a4fa-40c6-9214-2b2a28331f6b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:55.310939 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-16bfbb1f-64a0-45c2-88a8-b4051f15682c req-1d44f0af-8eab-485b-8916-a5a8e5a2f2bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60630f0f-2831-479d-91fc-477b773635ad", "name": "network-vif-plugged", "status": "completed", "tag": "87bcbdda-ce88-44b8-b537-66a7d29ac04f"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:41:55.321524 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-16bfbb1f-64a0-45c2-88a8-b4051f15682c req-1d44f0af-8eab-485b-8916-a5a8e5a2f2bc service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:55.321973 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-16bfbb1f-64a0-45c2-88a8-b4051f15682c req-1d44f0af-8eab-485b-8916-a5a8e5a2f2bc service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:55.326699 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:41:55.335131 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-16bfbb1f-64a0-45c2-88a8-b4051f15682c req-1d44f0af-8eab-485b-8916-a5a8e5a2f2bc service nova] Creating event network-vif-plugged:87bcbdda-ce88-44b8-b537-66a7d29ac04f for instance 60630f0f-2831-479d-91fc-477b773635ad on hv-cinder-74014 Jun 07 08:41:55.341140 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-16bfbb1f-64a0-45c2-88a8-b4051f15682c req-1d44f0af-8eab-485b-8916-a5a8e5a2f2bc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034374 Jun 07 08:41:55.341974 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 225/456] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:41:55.377745 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-4205d9c0-a4fa-40c6-9214-2b2a28331f6b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:55.387059 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-4205d9c0-a4fa-40c6-9214-2b2a28331f6b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1735 microversion: 2.1 time: 0.165624 Jun 07 08:41:55.387678 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 232/457] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:55 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:55.684467 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-40d693d9-9b2b-461b-aee1-00126b78c84a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:55.685194 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-40d693d9-9b2b-461b-aee1-00126b78c84a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:55.691708 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-40d693d9-9b2b-461b-aee1-00126b78c84a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:55.692154 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-40d693d9-9b2b-461b-aee1-00126b78c84a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:55.692917 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-40d693d9-9b2b-461b-aee1-00126b78c84a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:55.693370 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-40d693d9-9b2b-461b-aee1-00126b78c84a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:55.835517 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-40d693d9-9b2b-461b-aee1-00126b78c84a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:55.844678 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-40d693d9-9b2b-461b-aee1-00126b78c84a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:55.846229 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-40d693d9-9b2b-461b-aee1-00126b78c84a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:55.847407 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-40d693d9-9b2b-461b-aee1-00126b78c84a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.167618 Jun 07 08:41:55.847966 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 226/458] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:55 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:55.884927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-8086e7de-492f-4410-b714-4ed671dcc6e7 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:55.885638 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-8086e7de-492f-4410-b714-4ed671dcc6e7 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:55.891820 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8086e7de-492f-4410-b714-4ed671dcc6e7 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:55.892264 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8086e7de-492f-4410-b714-4ed671dcc6e7 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:55.893043 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8086e7de-492f-4410-b714-4ed671dcc6e7 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:55.893700 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8086e7de-492f-4410-b714-4ed671dcc6e7 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:56.091965 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-8086e7de-492f-4410-b714-4ed671dcc6e7 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:56.099511 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-8086e7de-492f-4410-b714-4ed671dcc6e7 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1357 microversion: 2.1 time: 0.220459 Jun 07 08:41:56.100088 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 233/459] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:55 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1357 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:56.404598 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-ccb41893-d7a6-4f41-8f9a-9e4d277b6aea tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:56.405117 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-ccb41893-d7a6-4f41-8f9a-9e4d277b6aea tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:56.411452 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ccb41893-d7a6-4f41-8f9a-9e4d277b6aea tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:56.411894 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ccb41893-d7a6-4f41-8f9a-9e4d277b6aea tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:56.412652 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ccb41893-d7a6-4f41-8f9a-9e4d277b6aea tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:56.413621 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ccb41893-d7a6-4f41-8f9a-9e4d277b6aea tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:56.549465 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-ccb41893-d7a6-4f41-8f9a-9e4d277b6aea tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:56.559223 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-ccb41893-d7a6-4f41-8f9a-9e4d277b6aea tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1735 microversion: 2.1 time: 0.158408 Jun 07 08:41:56.559984 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 227/460] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:56 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:56.866961 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-e1dc6dc0-d49e-45b0-8b40-0355a09ec969 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:56.867565 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-e1dc6dc0-d49e-45b0-8b40-0355a09ec969 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:56.874171 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e1dc6dc0-d49e-45b0-8b40-0355a09ec969 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:56.874612 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e1dc6dc0-d49e-45b0-8b40-0355a09ec969 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:56.875373 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e1dc6dc0-d49e-45b0-8b40-0355a09ec969 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:56.875805 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e1dc6dc0-d49e-45b0-8b40-0355a09ec969 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:57.011463 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-e1dc6dc0-d49e-45b0-8b40-0355a09ec969 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:57.020991 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-e1dc6dc0-d49e-45b0-8b40-0355a09ec969 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:57.022532 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-e1dc6dc0-d49e-45b0-8b40-0355a09ec969 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:57.023719 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-e1dc6dc0-d49e-45b0-8b40-0355a09ec969 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.161188 Jun 07 08:41:57.024392 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 234/461] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:56 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:57.117409 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-096c1944-4341-4358-a65d-1079c1b4cd40 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:57.118135 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-096c1944-4341-4358-a65d-1079c1b4cd40 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:57.125130 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-096c1944-4341-4358-a65d-1079c1b4cd40 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:57.125590 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-096c1944-4341-4358-a65d-1079c1b4cd40 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:57.126359 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-096c1944-4341-4358-a65d-1079c1b4cd40 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:57.126792 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-096c1944-4341-4358-a65d-1079c1b4cd40 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:57.270184 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-096c1944-4341-4358-a65d-1079c1b4cd40 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:57.278262 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-096c1944-4341-4358-a65d-1079c1b4cd40 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1357 microversion: 2.1 time: 0.165328 Jun 07 08:41:57.278822 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 228/462] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:57 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:57.355002 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-74bab7fb-a46d-4b74-917c-671f5f139907 req-48760e51-4479-4118-b2be-340794f755ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b308a6f5-2c8d-45ad-ace4-9b623bfa76db", "name": "network-vif-plugged", "status": "completed", "tag": "97a8e43e-a795-4fed-8696-2a901df6519b"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:41:57.363154 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-74bab7fb-a46d-4b74-917c-671f5f139907 req-48760e51-4479-4118-b2be-340794f755ce service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:57.363597 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-74bab7fb-a46d-4b74-917c-671f5f139907 req-48760e51-4479-4118-b2be-340794f755ce service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:57.374714 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-74bab7fb-a46d-4b74-917c-671f5f139907 req-48760e51-4479-4118-b2be-340794f755ce service nova] Creating event network-vif-plugged:97a8e43e-a795-4fed-8696-2a901df6519b for instance b308a6f5-2c8d-45ad-ace4-9b623bfa76db on hv-cinder-74014 Jun 07 08:41:57.379672 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-74bab7fb-a46d-4b74-917c-671f5f139907 req-48760e51-4479-4118-b2be-340794f755ce service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028399 Jun 07 08:41:57.380278 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 235/463] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:41:57.577517 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-c817ee8c-4954-4263-b6f0-c403ff110275 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:57.578174 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-c817ee8c-4954-4263-b6f0-c403ff110275 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:57.584533 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c817ee8c-4954-4263-b6f0-c403ff110275 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:57.585561 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c817ee8c-4954-4263-b6f0-c403ff110275 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:57.586333 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c817ee8c-4954-4263-b6f0-c403ff110275 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:57.586769 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c817ee8c-4954-4263-b6f0-c403ff110275 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:57.722029 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-c817ee8c-4954-4263-b6f0-c403ff110275 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:57.732202 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-c817ee8c-4954-4263-b6f0-c403ff110275 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1735 microversion: 2.1 time: 0.158469 Jun 07 08:41:57.732783 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 229/464] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:57 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:58.043414 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-964e384f-057d-435e-b362-4091346af982 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:58.044321 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-964e384f-057d-435e-b362-4091346af982 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:58.053169 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-964e384f-057d-435e-b362-4091346af982 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:58.054181 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-964e384f-057d-435e-b362-4091346af982 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:58.055133 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-964e384f-057d-435e-b362-4091346af982 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:58.055412 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-964e384f-057d-435e-b362-4091346af982 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:58.249707 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-964e384f-057d-435e-b362-4091346af982 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:58.261709 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-964e384f-057d-435e-b362-4091346af982 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:58.263227 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-964e384f-057d-435e-b362-4091346af982 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:58.264389 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-964e384f-057d-435e-b362-4091346af982 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.225405 Jun 07 08:41:58.264944 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 236/465] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:58 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:58.295231 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-77b63d58-4874-4dfd-9960-829fd9de93df tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:58.295849 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-77b63d58-4874-4dfd-9960-829fd9de93df tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:58.302514 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-77b63d58-4874-4dfd-9960-829fd9de93df tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:58.302964 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-77b63d58-4874-4dfd-9960-829fd9de93df tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:58.304250 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-77b63d58-4874-4dfd-9960-829fd9de93df tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:58.304691 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-77b63d58-4874-4dfd-9960-829fd9de93df tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:58.446154 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-77b63d58-4874-4dfd-9960-829fd9de93df tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:58.453755 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-77b63d58-4874-4dfd-9960-829fd9de93df tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1357 microversion: 2.1 time: 0.162300 Jun 07 08:41:58.454343 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 230/466] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:58 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:58.750085 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-d98a1879-d76e-4bd9-b30e-15fc3f3dde2d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:58.750702 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-d98a1879-d76e-4bd9-b30e-15fc3f3dde2d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:58.757590 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d98a1879-d76e-4bd9-b30e-15fc3f3dde2d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:58.758263 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d98a1879-d76e-4bd9-b30e-15fc3f3dde2d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:58.759063 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d98a1879-d76e-4bd9-b30e-15fc3f3dde2d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:58.759529 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d98a1879-d76e-4bd9-b30e-15fc3f3dde2d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:58.895715 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-d98a1879-d76e-4bd9-b30e-15fc3f3dde2d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:58.903953 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-d98a1879-d76e-4bd9-b30e-15fc3f3dde2d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1735 microversion: 2.1 time: 0.157817 Jun 07 08:41:58.904518 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 237/467] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:58 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:59.282611 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-0a97afe8-e53f-4053-b354-0e0c42c70aee tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:59.283234 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-0a97afe8-e53f-4053-b354-0e0c42c70aee tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:59.292408 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0a97afe8-e53f-4053-b354-0e0c42c70aee tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:59.292941 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0a97afe8-e53f-4053-b354-0e0c42c70aee tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:59.293525 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0a97afe8-e53f-4053-b354-0e0c42c70aee tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:59.293962 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0a97afe8-e53f-4053-b354-0e0c42c70aee tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:59.427459 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-0a97afe8-e53f-4053-b354-0e0c42c70aee tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:59.436964 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-0a97afe8-e53f-4053-b354-0e0c42c70aee tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:59.438500 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-0a97afe8-e53f-4053-b354-0e0c42c70aee tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:59.439670 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-0a97afe8-e53f-4053-b354-0e0c42c70aee tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1809 microversion: 2.20 time: 0.161285 Jun 07 08:41:59.440232 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 231/468] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:41:59 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:41:59.469767 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-7cf5a198-a96c-425f-b3f4-64483e71a7e0 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:59.470380 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-7cf5a198-a96c-425f-b3f4-64483e71a7e0 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:59.478250 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7cf5a198-a96c-425f-b3f4-64483e71a7e0 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:59.478905 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7cf5a198-a96c-425f-b3f4-64483e71a7e0 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:59.479698 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7cf5a198-a96c-425f-b3f4-64483e71a7e0 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:59.480135 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7cf5a198-a96c-425f-b3f4-64483e71a7e0 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:59.610772 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-7cf5a198-a96c-425f-b3f4-64483e71a7e0 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:41:59.618935 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-7cf5a198-a96c-425f-b3f4-64483e71a7e0 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1357 microversion: 2.1 time: 0.152963 Jun 07 08:41:59.619519 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 238/469] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:59 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:41:59.921090 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-53beef2e-fa24-4116-b952-2e5d2260fa73 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:41:59.922955 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-53beef2e-fa24-4116-b952-2e5d2260fa73 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:41:59.927734 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-53beef2e-fa24-4116-b952-2e5d2260fa73 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:59.928178 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-53beef2e-fa24-4116-b952-2e5d2260fa73 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:41:59.929071 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-53beef2e-fa24-4116-b952-2e5d2260fa73 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:41:59.929514 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-53beef2e-fa24-4116-b952-2e5d2260fa73 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:00.061309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-53beef2e-fa24-4116-b952-2e5d2260fa73 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:00.070336 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-53beef2e-fa24-4116-b952-2e5d2260fa73 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1735 microversion: 2.1 time: 0.152986 Jun 07 08:42:00.070921 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 232/470] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:41:59 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:00.458301 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-698eefa4-22e6-4060-9b25-dc3ff8ab5d2c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:00.458834 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-698eefa4-22e6-4060-9b25-dc3ff8ab5d2c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:00.465172 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-698eefa4-22e6-4060-9b25-dc3ff8ab5d2c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:00.465620 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-698eefa4-22e6-4060-9b25-dc3ff8ab5d2c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:00.466380 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-698eefa4-22e6-4060-9b25-dc3ff8ab5d2c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:00.466816 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-698eefa4-22e6-4060-9b25-dc3ff8ab5d2c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:00.612575 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-698eefa4-22e6-4060-9b25-dc3ff8ab5d2c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:00.621724 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-698eefa4-22e6-4060-9b25-dc3ff8ab5d2c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:00.623231 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-698eefa4-22e6-4060-9b25-dc3ff8ab5d2c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:00.624371 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-698eefa4-22e6-4060-9b25-dc3ff8ab5d2c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1796 microversion: 2.20 time: 0.170148 Jun 07 08:42:00.624925 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 239/471] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:42:00 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1796 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:42:00.636128 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-5bd33529-757b-4d40-b19c-e4bd51733fec tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:00.636772 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-5bd33529-757b-4d40-b19c-e4bd51733fec tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:00.643241 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5bd33529-757b-4d40-b19c-e4bd51733fec tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:00.643682 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5bd33529-757b-4d40-b19c-e4bd51733fec tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:00.644431 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5bd33529-757b-4d40-b19c-e4bd51733fec tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:00.644861 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5bd33529-757b-4d40-b19c-e4bd51733fec tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:00.773808 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-5bd33529-757b-4d40-b19c-e4bd51733fec tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:00.781192 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-5bd33529-757b-4d40-b19c-e4bd51733fec tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1547 microversion: 2.1 time: 0.149498 Jun 07 08:42:00.782026 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 233/472] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:00 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:00.798300 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-869297c8-cab9-4956-b4f5-bcb35b57355c tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:00.798903 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-869297c8-cab9-4956-b4f5-bcb35b57355c tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:00.805385 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-869297c8-cab9-4956-b4f5-bcb35b57355c tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:00.805829 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-869297c8-cab9-4956-b4f5-bcb35b57355c tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:00.806574 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-869297c8-cab9-4956-b4f5-bcb35b57355c tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:00.807007 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-869297c8-cab9-4956-b4f5-bcb35b57355c tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:00.932436 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-869297c8-cab9-4956-b4f5-bcb35b57355c tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:00.939787 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-869297c8-cab9-4956-b4f5-bcb35b57355c tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1547 microversion: 2.1 time: 0.145245 Jun 07 08:42:00.940340 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 240/473] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:00 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1547 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:00.955936 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-adb62a91-9d03-400d-a9a9-958ee57f9afa tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:00.959403 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-adb62a91-9d03-400d-a9a9-958ee57f9afa tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:00.960817 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-adb62a91-9d03-400d-a9a9-958ee57f9afa tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Searching by: {'deleted': False, 'project_id': '1e49af480c6c4449b329b5e71904b17c'} {{(pid=129726) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 07 08:42:00.967969 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-adb62a91-9d03-400d-a9a9-958ee57f9afa tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:00.968546 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-adb62a91-9d03-400d-a9a9-958ee57f9afa tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:00.969442 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-adb62a91-9d03-400d-a9a9-958ee57f9afa tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:00.969874 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-adb62a91-9d03-400d-a9a9-958ee57f9afa tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:01.060777 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.multi_cell_list [None req-adb62a91-9d03-400d-a9a9-958ee57f9afa tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129726) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 07 08:42:01.088534 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-5902eeeb-c56d-4359-8546-a8f3dc591031 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:01.089183 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-5902eeeb-c56d-4359-8546-a8f3dc591031 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:01.095346 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5902eeeb-c56d-4359-8546-a8f3dc591031 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:01.095796 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5902eeeb-c56d-4359-8546-a8f3dc591031 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:01.096570 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5902eeeb-c56d-4359-8546-a8f3dc591031 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:01.097021 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5902eeeb-c56d-4359-8546-a8f3dc591031 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:01.161556 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-adb62a91-9d03-400d-a9a9-958ee57f9afa tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.209315 Jun 07 08:42:01.162144 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 234/474] 10.222.0.17 () {58 vars in 1124 bytes} [Tue Jun 7 08:42:00 2022] GET /compute/v2.1/servers => generated 342 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:42:01.172955 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-c14c9e96-a1a2-4148-b802-6dff8730543c tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:01.173910 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-c14c9e96-a1a2-4148-b802-6dff8730543c tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:01.184210 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c14c9e96-a1a2-4148-b802-6dff8730543c tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:01.184669 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c14c9e96-a1a2-4148-b802-6dff8730543c tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:01.185478 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c14c9e96-a1a2-4148-b802-6dff8730543c tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:01.185920 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c14c9e96-a1a2-4148-b802-6dff8730543c tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:01.236124 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-5902eeeb-c56d-4359-8546-a8f3dc591031 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:01.247111 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-5902eeeb-c56d-4359-8546-a8f3dc591031 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1735 microversion: 2.1 time: 0.162974 Jun 07 08:42:01.247956 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 241/475] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:01 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:42:01.325926 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-c14c9e96-a1a2-4148-b802-6dff8730543c tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:01.333837 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-c14c9e96-a1a2-4148-b802-6dff8730543c tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1547 microversion: 2.1 time: 0.165212 Jun 07 08:42:01.334419 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 235/476] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:01 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1547 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:42:02.265534 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-0a86a87c-05b5-4970-b9ff-82e35467610f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:02.266141 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-0a86a87c-05b5-4970-b9ff-82e35467610f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:02.273530 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0a86a87c-05b5-4970-b9ff-82e35467610f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:02.273973 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0a86a87c-05b5-4970-b9ff-82e35467610f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:02.274731 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0a86a87c-05b5-4970-b9ff-82e35467610f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:02.275166 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0a86a87c-05b5-4970-b9ff-82e35467610f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:02.413615 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-0a86a87c-05b5-4970-b9ff-82e35467610f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:02.422196 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-0a86a87c-05b5-4970-b9ff-82e35467610f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1735 microversion: 2.1 time: 0.160355 Jun 07 08:42:02.422665 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 242/477] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:02 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:03.131552 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-b98db7b7-2dae-4c6a-a617-17229af62d4e tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cfcc8093-adc1-4747-8eb1-dd11c062a012"}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:42:03.132656 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-b98db7b7-2dae-4c6a-a617-17229af62d4e tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:03.139129 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b98db7b7-2dae-4c6a-a617-17229af62d4e tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:03.139550 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b98db7b7-2dae-4c6a-a617-17229af62d4e tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:03.140310 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b98db7b7-2dae-4c6a-a617-17229af62d4e tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:03.140778 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b98db7b7-2dae-4c6a-a617-17229af62d4e tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:03.440738 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-41f5025e-e802-4a49-b973-fe463f52b440 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:03.441388 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-41f5025e-e802-4a49-b973-fe463f52b440 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:03.448450 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-41f5025e-e802-4a49-b973-fe463f52b440 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:03.448893 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-41f5025e-e802-4a49-b973-fe463f52b440 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:03.449685 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-41f5025e-e802-4a49-b973-fe463f52b440 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:03.450112 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-41f5025e-e802-4a49-b973-fe463f52b440 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:03.585181 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-41f5025e-e802-4a49-b973-fe463f52b440 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:03.593971 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-41f5025e-e802-4a49-b973-fe463f52b440 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1735 microversion: 2.1 time: 0.156850 Jun 07 08:42:03.594554 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 243/478] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:03 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:42:03.821957 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-b98db7b7-2dae-4c6a-a617-17229af62d4e tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "POST /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.694035 Jun 07 08:42:03.822720 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 236/479] 10.222.0.17 () {60 vars in 1322 bytes} [Tue Jun 7 08:42:03 2022] POST /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db/os-volume_attachments => generated 194 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:42:04.611915 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-a8c56fa8-6dd3-47ba-9d08-7fb9e9033bb2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:04.612437 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-a8c56fa8-6dd3-47ba-9d08-7fb9e9033bb2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:04.619596 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a8c56fa8-6dd3-47ba-9d08-7fb9e9033bb2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:04.620043 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a8c56fa8-6dd3-47ba-9d08-7fb9e9033bb2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:04.620805 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a8c56fa8-6dd3-47ba-9d08-7fb9e9033bb2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:04.621267 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a8c56fa8-6dd3-47ba-9d08-7fb9e9033bb2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:04.754819 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-a8c56fa8-6dd3-47ba-9d08-7fb9e9033bb2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:04.757708 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=100 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:42:04.764065 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-a8c56fa8-6dd3-47ba-9d08-7fb9e9033bb2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1735 microversion: 2.1 time: 0.156051 Jun 07 08:42:04.764628 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 244/480] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:04 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:05.782988 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-9634f7f3-e0f9-45c5-9ef7-f627d73797ed tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:05.783799 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-9634f7f3-e0f9-45c5-9ef7-f627d73797ed tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:05.790610 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9634f7f3-e0f9-45c5-9ef7-f627d73797ed tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:05.791056 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9634f7f3-e0f9-45c5-9ef7-f627d73797ed tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:05.791810 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9634f7f3-e0f9-45c5-9ef7-f627d73797ed tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:05.792246 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9634f7f3-e0f9-45c5-9ef7-f627d73797ed tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:05.922509 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-9634f7f3-e0f9-45c5-9ef7-f627d73797ed tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:05.930403 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-9634f7f3-e0f9-45c5-9ef7-f627d73797ed tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1735 microversion: 2.1 time: 0.152363 Jun 07 08:42:05.930964 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 237/481] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:05 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:06.948224 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-49fc16ee-c5a7-4810-8f6d-879e6f0be83b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:06.948840 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-49fc16ee-c5a7-4810-8f6d-879e6f0be83b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:06.955767 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-49fc16ee-c5a7-4810-8f6d-879e6f0be83b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:06.956217 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-49fc16ee-c5a7-4810-8f6d-879e6f0be83b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:06.957019 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-49fc16ee-c5a7-4810-8f6d-879e6f0be83b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:06.957470 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-49fc16ee-c5a7-4810-8f6d-879e6f0be83b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:07.097231 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-49fc16ee-c5a7-4810-8f6d-879e6f0be83b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:07.105320 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-49fc16ee-c5a7-4810-8f6d-879e6f0be83b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1735 microversion: 2.1 time: 0.161952 Jun 07 08:42:07.109856 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 245/482] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:06 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:08.123005 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-10bf9c2f-fdc0-43ae-b928-a7aec96058fc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:08.123642 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-10bf9c2f-fdc0-43ae-b928-a7aec96058fc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:08.130465 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-10bf9c2f-fdc0-43ae-b928-a7aec96058fc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:08.130913 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-10bf9c2f-fdc0-43ae-b928-a7aec96058fc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:08.131679 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-10bf9c2f-fdc0-43ae-b928-a7aec96058fc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:08.132113 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-10bf9c2f-fdc0-43ae-b928-a7aec96058fc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:08.271280 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-10bf9c2f-fdc0-43ae-b928-a7aec96058fc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:08.279782 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-10bf9c2f-fdc0-43ae-b928-a7aec96058fc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1735 microversion: 2.1 time: 0.160628 Jun 07 08:42:08.280354 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 238/483] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:08 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:09.298609 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-c6eeb79d-d764-46f7-90aa-9450d5e64780 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:09.299299 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-c6eeb79d-d764-46f7-90aa-9450d5e64780 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:09.305952 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c6eeb79d-d764-46f7-90aa-9450d5e64780 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:09.306397 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c6eeb79d-d764-46f7-90aa-9450d5e64780 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:09.307169 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c6eeb79d-d764-46f7-90aa-9450d5e64780 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:09.307602 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c6eeb79d-d764-46f7-90aa-9450d5e64780 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:09.437998 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-c6eeb79d-d764-46f7-90aa-9450d5e64780 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:09.446046 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-c6eeb79d-d764-46f7-90aa-9450d5e64780 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1735 microversion: 2.1 time: 0.151165 Jun 07 08:42:09.446551 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 246/484] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:09 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:10.462220 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-1346700c-d5ce-413c-83f9-baee3a4c6bce tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:10.462821 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-1346700c-d5ce-413c-83f9-baee3a4c6bce tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:10.465330 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_api:SELECT=60 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:42:10.470318 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1346700c-d5ce-413c-83f9-baee3a4c6bce tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:10.474687 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1346700c-d5ce-413c-83f9-baee3a4c6bce tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:10.474687 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1346700c-d5ce-413c-83f9-baee3a4c6bce tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:10.474687 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1346700c-d5ce-413c-83f9-baee3a4c6bce tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:10.611680 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-1346700c-d5ce-413c-83f9-baee3a4c6bce tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:10.621814 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-1346700c-d5ce-413c-83f9-baee3a4c6bce tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1735 microversion: 2.1 time: 0.163361 Jun 07 08:42:10.622621 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 239/485] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:10 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:11.536422 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-6e7fc543-900e-4396-ad19-95d328aa919b tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:11.537086 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-6e7fc543-900e-4396-ad19-95d328aa919b tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:11.544052 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6e7fc543-900e-4396-ad19-95d328aa919b tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:11.544498 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6e7fc543-900e-4396-ad19-95d328aa919b tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:11.545284 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6e7fc543-900e-4396-ad19-95d328aa919b tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:11.545717 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6e7fc543-900e-4396-ad19-95d328aa919b tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:11.638656 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-d717f911-d8e8-4536-bfe5-8d66404691f9 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:11.639256 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-d717f911-d8e8-4536-bfe5-8d66404691f9 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:11.641119 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell0:SELECT=2 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:42:11.646427 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d717f911-d8e8-4536-bfe5-8d66404691f9 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:11.646875 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d717f911-d8e8-4536-bfe5-8d66404691f9 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:11.647641 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d717f911-d8e8-4536-bfe5-8d66404691f9 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:11.648148 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d717f911-d8e8-4536-bfe5-8d66404691f9 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:11.677634 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-6e7fc543-900e-4396-ad19-95d328aa919b tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:11.686297 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-6e7fc543-900e-4396-ad19-95d328aa919b tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1593 microversion: 2.1 time: 0.153587 Jun 07 08:42:11.686893 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 247/486] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:11 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1593 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:11.784140 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-d717f911-d8e8-4536-bfe5-8d66404691f9 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:11.787787 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:42:11.793326 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-d717f911-d8e8-4536-bfe5-8d66404691f9 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1735 microversion: 2.1 time: 0.158292 Jun 07 08:42:11.794135 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 240/487] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:11 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:42:12.811727 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-c8ce0d3a-d4b4-45d1-988f-43bd2568bac9 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:12.812338 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-c8ce0d3a-d4b4-45d1-988f-43bd2568bac9 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:12.818871 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c8ce0d3a-d4b4-45d1-988f-43bd2568bac9 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:12.822227 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c8ce0d3a-d4b4-45d1-988f-43bd2568bac9 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:12.822227 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c8ce0d3a-d4b4-45d1-988f-43bd2568bac9 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:12.822227 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c8ce0d3a-d4b4-45d1-988f-43bd2568bac9 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:12.951444 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-c8ce0d3a-d4b4-45d1-988f-43bd2568bac9 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:12.959430 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-c8ce0d3a-d4b4-45d1-988f-43bd2568bac9 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1735 microversion: 2.1 time: 0.151633 Jun 07 08:42:12.959987 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 248/488] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:12 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:13.062770 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-ff60984e-6559-4efa-8a07-f4bfe513931f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:13.063406 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-ff60984e-6559-4efa-8a07-f4bfe513931f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:13.070680 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ff60984e-6559-4efa-8a07-f4bfe513931f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:13.071130 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ff60984e-6559-4efa-8a07-f4bfe513931f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:13.071895 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ff60984e-6559-4efa-8a07-f4bfe513931f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:13.072339 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ff60984e-6559-4efa-8a07-f4bfe513931f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:13.202608 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.objects.instance [None req-ff60984e-6559-4efa-8a07-f4bfe513931f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lazy-loading 'services' on Instance uuid 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 {{(pid=129726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:42:13.508959 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-ff60984e-6559-4efa-8a07-f4bfe513931f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7/os-volume_attachments/af821d37-774b-48d5-9874-8bba4c76f3a3" status: 202 len: 0 microversion: 2.1 time: 0.450502 Jun 07 08:42:13.509728 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 241/489] 10.222.0.17 () {58 vars in 1415 bytes} [Tue Jun 7 08:42:13 2022] DELETE /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7/os-volume_attachments/af821d37-774b-48d5-9874-8bba4c76f3a3 => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 08:42:13.739807 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-31f24f43-900a-414f-a3f6-4541859c5c87 req-c0b9cd0e-aec4-4cf9-b953-2e3213d07f0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b308a6f5-2c8d-45ad-ace4-9b623bfa76db", "tag": "97a8e43e-a795-4fed-8696-2a901df6519b"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:42:13.748211 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-31f24f43-900a-414f-a3f6-4541859c5c87 req-c0b9cd0e-aec4-4cf9-b953-2e3213d07f0a service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:13.748654 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-31f24f43-900a-414f-a3f6-4541859c5c87 req-c0b9cd0e-aec4-4cf9-b953-2e3213d07f0a service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:13.760543 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-31f24f43-900a-414f-a3f6-4541859c5c87 req-c0b9cd0e-aec4-4cf9-b953-2e3213d07f0a service nova] Creating event network-changed:97a8e43e-a795-4fed-8696-2a901df6519b for instance b308a6f5-2c8d-45ad-ace4-9b623bfa76db on hv-cinder-74014 Jun 07 08:42:13.765612 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-31f24f43-900a-414f-a3f6-4541859c5c87 req-c0b9cd0e-aec4-4cf9-b953-2e3213d07f0a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029634 Jun 07 08:42:13.767625 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 249/490] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:42:13.976981 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-c855145b-1a32-49bf-a544-80a33229724e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:13.977731 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-c855145b-1a32-49bf-a544-80a33229724e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:13.984266 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c855145b-1a32-49bf-a544-80a33229724e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:13.984848 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c855145b-1a32-49bf-a544-80a33229724e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:13.985567 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c855145b-1a32-49bf-a544-80a33229724e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:13.986006 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c855145b-1a32-49bf-a544-80a33229724e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:14.131055 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-c855145b-1a32-49bf-a544-80a33229724e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:14.141825 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-c855145b-1a32-49bf-a544-80a33229724e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1735 microversion: 2.1 time: 0.168957 Jun 07 08:42:14.145053 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 242/491] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:13 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:14.820737 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-5e630875-ac18-4c78-a5fc-836145bccf53 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:42:14.827601 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5e630875-ac18-4c78-a5fc-836145bccf53 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:14.828060 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5e630875-ac18-4c78-a5fc-836145bccf53 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:14.853719 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-5e630875-ac18-4c78-a5fc-836145bccf53 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Going to try to stop instance {{(pid=129725) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 07 08:42:15.025869 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-5e630875-ac18-4c78-a5fc-836145bccf53 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "POST /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7/action" status: 202 len: 0 microversion: 2.1 time: 0.209586 Jun 07 08:42:15.026606 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 250/492] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jun 7 08:42:14 2022] POST /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 08:42:15.035436 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-51e7bc9f-d1ef-4ce7-aa8e-9f7eb6704a6b tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:15.036532 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-51e7bc9f-d1ef-4ce7-aa8e-9f7eb6704a6b tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:15.052432 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-51e7bc9f-d1ef-4ce7-aa8e-9f7eb6704a6b tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:15.052881 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-51e7bc9f-d1ef-4ce7-aa8e-9f7eb6704a6b tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:15.053750 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-51e7bc9f-d1ef-4ce7-aa8e-9f7eb6704a6b tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:15.054219 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-51e7bc9f-d1ef-4ce7-aa8e-9f7eb6704a6b tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:15.160025 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-de0bffd2-bb12-452c-95f1-1ddc99f71a04 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:15.160743 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-de0bffd2-bb12-452c-95f1-1ddc99f71a04 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:15.167003 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-de0bffd2-bb12-452c-95f1-1ddc99f71a04 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:15.167452 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-de0bffd2-bb12-452c-95f1-1ddc99f71a04 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:15.168244 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-de0bffd2-bb12-452c-95f1-1ddc99f71a04 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:15.168810 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-de0bffd2-bb12-452c-95f1-1ddc99f71a04 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:15.223698 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-51e7bc9f-d1ef-4ce7-aa8e-9f7eb6704a6b tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:15.235415 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-51e7bc9f-d1ef-4ce7-aa8e-9f7eb6704a6b tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1675 microversion: 2.1 time: 0.204228 Jun 07 08:42:15.239887 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 243/493] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:15 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1675 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:15.313739 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-de0bffd2-bb12-452c-95f1-1ddc99f71a04 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:15.322252 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-de0bffd2-bb12-452c-95f1-1ddc99f71a04 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1735 microversion: 2.1 time: 0.166739 Jun 07 08:42:15.322815 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 251/494] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:15 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:42:16.257952 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-20639480-970d-4969-b180-5b1afc9e5372 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:16.310404 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-20639480-970d-4969-b180-5b1afc9e5372 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:16.310404 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-20639480-970d-4969-b180-5b1afc9e5372 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:16.310404 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-20639480-970d-4969-b180-5b1afc9e5372 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:16.310404 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-20639480-970d-4969-b180-5b1afc9e5372 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:16.310801 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-20639480-970d-4969-b180-5b1afc9e5372 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:16.339772 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-be672c5b-e8aa-480c-8dec-28c42f46ddf1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:16.340362 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-be672c5b-e8aa-480c-8dec-28c42f46ddf1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:16.348117 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-be672c5b-e8aa-480c-8dec-28c42f46ddf1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:16.348569 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-be672c5b-e8aa-480c-8dec-28c42f46ddf1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:16.349408 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-be672c5b-e8aa-480c-8dec-28c42f46ddf1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:16.349844 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-be672c5b-e8aa-480c-8dec-28c42f46ddf1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:16.499806 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-be672c5b-e8aa-480c-8dec-28c42f46ddf1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:16.508732 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-be672c5b-e8aa-480c-8dec-28c42f46ddf1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1735 microversion: 2.1 time: 0.172912 Jun 07 08:42:16.509337 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 252/495] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:16 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:42:16.612393 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-20639480-970d-4969-b180-5b1afc9e5372 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:16.620002 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-20639480-970d-4969-b180-5b1afc9e5372 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1675 microversion: 2.1 time: 0.370534 Jun 07 08:42:16.620567 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 244/496] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:16 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1675 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:16.901725 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-3bb2b48c-2f47-430e-90f2-d7e7da7d42b8 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-822756039"}} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:42:16.902301 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-3bb2b48c-2f47-430e-90f2-d7e7da7d42b8 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:16.908506 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3bb2b48c-2f47-430e-90f2-d7e7da7d42b8 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:16.908946 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3bb2b48c-2f47-430e-90f2-d7e7da7d42b8 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:16.909795 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3bb2b48c-2f47-430e-90f2-d7e7da7d42b8 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:16.910224 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3bb2b48c-2f47-430e-90f2-d7e7da7d42b8 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:17.035845 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.network.security_group_api [None req-3bb2b48c-2f47-430e-90f2-d7e7da7d42b8 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Adding security group 6c5aad48-f650-47a3-85d4-ed8bb2fa1526 to port 97a8e43e-a795-4fed-8696-2a901df6519b Jun 07 08:42:17.469563 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-3bb2b48c-2f47-430e-90f2-d7e7da7d42b8 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "POST /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db/action" status: 202 len: 0 microversion: 2.1 time: 0.572528 Jun 07 08:42:17.471123 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 253/497] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jun 7 08:42:16 2022] POST /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db/action => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 08:42:17.479877 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-09b9f606-972b-4c44-861c-e9f2eef5bbac tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:17.481058 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-09b9f606-972b-4c44-861c-e9f2eef5bbac tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:17.485344 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-9fe39b45-b9b5-4e20-bcaa-5be34def42d6 req-c1b12f10-9856-4afa-b0d4-0392af05e344 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b308a6f5-2c8d-45ad-ace4-9b623bfa76db", "tag": "97a8e43e-a795-4fed-8696-2a901df6519b"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:42:17.488317 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-09b9f606-972b-4c44-861c-e9f2eef5bbac tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:17.489290 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-09b9f606-972b-4c44-861c-e9f2eef5bbac tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:17.490290 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-09b9f606-972b-4c44-861c-e9f2eef5bbac tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:17.491082 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-09b9f606-972b-4c44-861c-e9f2eef5bbac tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:17.498435 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-9fe39b45-b9b5-4e20-bcaa-5be34def42d6 req-c1b12f10-9856-4afa-b0d4-0392af05e344 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:17.499161 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-9fe39b45-b9b5-4e20-bcaa-5be34def42d6 req-c1b12f10-9856-4afa-b0d4-0392af05e344 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:17.527497 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-9fe39b45-b9b5-4e20-bcaa-5be34def42d6 req-c1b12f10-9856-4afa-b0d4-0392af05e344 service nova] Creating event network-changed:97a8e43e-a795-4fed-8696-2a901df6519b for instance b308a6f5-2c8d-45ad-ace4-9b623bfa76db on hv-cinder-74014 Jun 07 08:42:17.536240 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-9fe39b45-b9b5-4e20-bcaa-5be34def42d6 req-c1b12f10-9856-4afa-b0d4-0392af05e344 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053995 Jun 07 08:42:17.539789 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 254/498] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:42:17.544842 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-6c1858cb-a8f0-4cb7-a5af-a2e7ce115304 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:17.545576 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-6c1858cb-a8f0-4cb7-a5af-a2e7ce115304 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:17.553340 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6c1858cb-a8f0-4cb7-a5af-a2e7ce115304 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:17.555355 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6c1858cb-a8f0-4cb7-a5af-a2e7ce115304 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:17.556548 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6c1858cb-a8f0-4cb7-a5af-a2e7ce115304 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:17.557424 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6c1858cb-a8f0-4cb7-a5af-a2e7ce115304 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:17.701091 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-09b9f606-972b-4c44-861c-e9f2eef5bbac tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:17.710224 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-09b9f606-972b-4c44-861c-e9f2eef5bbac tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1758 microversion: 2.1 time: 0.233961 Jun 07 08:42:17.711053 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 245/499] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:17 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1758 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:17.716139 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-05da6704-71e3-431e-a00b-e33301523581 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:17.717122 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-05da6704-71e3-431e-a00b-e33301523581 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:17.725330 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-05da6704-71e3-431e-a00b-e33301523581 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:17.726497 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-05da6704-71e3-431e-a00b-e33301523581 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:17.728025 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-05da6704-71e3-431e-a00b-e33301523581 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:17.728662 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-05da6704-71e3-431e-a00b-e33301523581 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:17.836731 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-6c1858cb-a8f0-4cb7-a5af-a2e7ce115304 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:17.847725 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-6c1858cb-a8f0-4cb7-a5af-a2e7ce115304 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1735 microversion: 2.1 time: 0.309265 Jun 07 08:42:17.848952 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 255/500] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:17 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1735 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:17.889014 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-05da6704-71e3-431e-a00b-e33301523581 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:17.898413 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-05da6704-71e3-431e-a00b-e33301523581 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1675 microversion: 2.1 time: 0.185558 Jun 07 08:42:17.899004 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 246/501] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:17 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1675 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:18.864700 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-a0040336-f402-499c-adea-a6bc164805e2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:18.865341 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-a0040336-f402-499c-adea-a6bc164805e2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:18.872342 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a0040336-f402-499c-adea-a6bc164805e2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:18.872792 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a0040336-f402-499c-adea-a6bc164805e2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:18.873586 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a0040336-f402-499c-adea-a6bc164805e2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:18.874023 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a0040336-f402-499c-adea-a6bc164805e2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:18.918142 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-b31bb41c-2cdd-44cc-aed7-eb846daab3e8 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:18.918888 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-b31bb41c-2cdd-44cc-aed7-eb846daab3e8 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:18.925199 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b31bb41c-2cdd-44cc-aed7-eb846daab3e8 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:18.925655 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b31bb41c-2cdd-44cc-aed7-eb846daab3e8 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:18.926432 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b31bb41c-2cdd-44cc-aed7-eb846daab3e8 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:18.926941 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b31bb41c-2cdd-44cc-aed7-eb846daab3e8 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:19.009487 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-a0040336-f402-499c-adea-a6bc164805e2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:19.017604 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-a0040336-f402-499c-adea-a6bc164805e2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1735 microversion: 2.1 time: 0.156697 Jun 07 08:42:19.018275 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 256/502] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:18 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:19.060536 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-b31bb41c-2cdd-44cc-aed7-eb846daab3e8 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:19.068006 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-b31bb41c-2cdd-44cc-aed7-eb846daab3e8 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1675 microversion: 2.1 time: 0.153665 Jun 07 08:42:19.068563 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 247/503] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:18 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:42:20.034950 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-02f6e99f-1b5e-47c1-942b-c19de33202f6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:20.035563 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-02f6e99f-1b5e-47c1-942b-c19de33202f6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:20.042842 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-02f6e99f-1b5e-47c1-942b-c19de33202f6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:20.043282 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-02f6e99f-1b5e-47c1-942b-c19de33202f6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:20.044035 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-02f6e99f-1b5e-47c1-942b-c19de33202f6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:20.044468 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-02f6e99f-1b5e-47c1-942b-c19de33202f6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:20.085671 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-f065d57b-c4b5-4128-b9cd-4d30fbae3f32 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:20.087101 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-f065d57b-c4b5-4128-b9cd-4d30fbae3f32 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:20.093942 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f065d57b-c4b5-4128-b9cd-4d30fbae3f32 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:20.094611 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f065d57b-c4b5-4128-b9cd-4d30fbae3f32 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:20.095382 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f065d57b-c4b5-4128-b9cd-4d30fbae3f32 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:20.095817 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f065d57b-c4b5-4128-b9cd-4d30fbae3f32 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:20.189535 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-02f6e99f-1b5e-47c1-942b-c19de33202f6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:20.197544 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-02f6e99f-1b5e-47c1-942b-c19de33202f6 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1735 microversion: 2.1 time: 0.166597 Jun 07 08:42:20.198351 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 257/504] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:20 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:20.232032 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-f065d57b-c4b5-4128-b9cd-4d30fbae3f32 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:20.239648 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-f065d57b-c4b5-4128-b9cd-4d30fbae3f32 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1675 microversion: 2.1 time: 0.157771 Jun 07 08:42:20.240214 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 248/505] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:20 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:42:21.214701 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-cd4edf1c-2f2c-4a0e-87c1-bca315ca3919 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:21.215310 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-cd4edf1c-2f2c-4a0e-87c1-bca315ca3919 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:21.221830 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-cd4edf1c-2f2c-4a0e-87c1-bca315ca3919 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:21.222280 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-cd4edf1c-2f2c-4a0e-87c1-bca315ca3919 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:21.223027 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-cd4edf1c-2f2c-4a0e-87c1-bca315ca3919 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:21.223458 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-cd4edf1c-2f2c-4a0e-87c1-bca315ca3919 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:21.256298 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-96bde13f-cbe8-46d0-86cd-1242af1cf599 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:21.257086 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-96bde13f-cbe8-46d0-86cd-1242af1cf599 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:21.263659 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-96bde13f-cbe8-46d0-86cd-1242af1cf599 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:21.264111 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-96bde13f-cbe8-46d0-86cd-1242af1cf599 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:21.264882 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-96bde13f-cbe8-46d0-86cd-1242af1cf599 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:21.265351 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-96bde13f-cbe8-46d0-86cd-1242af1cf599 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:21.350560 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-cd4edf1c-2f2c-4a0e-87c1-bca315ca3919 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:21.359015 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-cd4edf1c-2f2c-4a0e-87c1-bca315ca3919 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1735 microversion: 2.1 time: 0.148679 Jun 07 08:42:21.359585 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 258/506] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:21 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:21.395069 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-96bde13f-cbe8-46d0-86cd-1242af1cf599 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:21.402992 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-96bde13f-cbe8-46d0-86cd-1242af1cf599 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1675 microversion: 2.1 time: 0.150494 Jun 07 08:42:21.403547 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 249/507] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:21 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:42:22.376561 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-a2051ba2-8701-41e9-8a9a-9bf5a94427c1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:22.377128 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-a2051ba2-8701-41e9-8a9a-9bf5a94427c1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:22.383751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a2051ba2-8701-41e9-8a9a-9bf5a94427c1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:22.384200 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a2051ba2-8701-41e9-8a9a-9bf5a94427c1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:22.384961 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a2051ba2-8701-41e9-8a9a-9bf5a94427c1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:22.385428 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a2051ba2-8701-41e9-8a9a-9bf5a94427c1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:22.420356 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-33a9c0cb-5c8f-482f-852b-145de21b3796 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:22.421214 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-33a9c0cb-5c8f-482f-852b-145de21b3796 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:22.428367 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-33a9c0cb-5c8f-482f-852b-145de21b3796 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:22.428771 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-33a9c0cb-5c8f-482f-852b-145de21b3796 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:22.430270 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-33a9c0cb-5c8f-482f-852b-145de21b3796 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:22.430777 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-33a9c0cb-5c8f-482f-852b-145de21b3796 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:22.511806 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-a2051ba2-8701-41e9-8a9a-9bf5a94427c1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:22.519792 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-a2051ba2-8701-41e9-8a9a-9bf5a94427c1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1735 microversion: 2.1 time: 0.147989 Jun 07 08:42:22.520358 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 259/508] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:22 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:22.561275 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-33a9c0cb-5c8f-482f-852b-145de21b3796 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:22.568609 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-33a9c0cb-5c8f-482f-852b-145de21b3796 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1675 microversion: 2.1 time: 0.152297 Jun 07 08:42:22.569212 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 250/509] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:22 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:42:23.536563 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-02ff8403-75b2-4192-b6f0-64ddc89e43b9 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:23.537244 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-02ff8403-75b2-4192-b6f0-64ddc89e43b9 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:23.539743 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_api:SELECT=64 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:42:23.544351 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-02ff8403-75b2-4192-b6f0-64ddc89e43b9 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:23.544982 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-02ff8403-75b2-4192-b6f0-64ddc89e43b9 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:23.545614 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-02ff8403-75b2-4192-b6f0-64ddc89e43b9 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:23.546049 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-02ff8403-75b2-4192-b6f0-64ddc89e43b9 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:23.586207 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-13118dad-03a6-4398-9867-593092f79bcd tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:23.586873 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-13118dad-03a6-4398-9867-593092f79bcd tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:23.593362 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-13118dad-03a6-4398-9867-593092f79bcd tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:23.593812 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-13118dad-03a6-4398-9867-593092f79bcd tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:23.594570 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-13118dad-03a6-4398-9867-593092f79bcd tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:23.595066 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-13118dad-03a6-4398-9867-593092f79bcd tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:23.679384 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-02ff8403-75b2-4192-b6f0-64ddc89e43b9 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:23.687326 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-02ff8403-75b2-4192-b6f0-64ddc89e43b9 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1735 microversion: 2.1 time: 0.154695 Jun 07 08:42:23.688099 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 260/510] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:23 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:23.727485 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-13118dad-03a6-4398-9867-593092f79bcd tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:23.734955 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-13118dad-03a6-4398-9867-593092f79bcd tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1675 microversion: 2.1 time: 0.153016 Jun 07 08:42:23.735453 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 251/511] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:23 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:42:24.705604 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-1deb99ee-58dd-450e-947a-e93450f48b32 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:24.706237 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-1deb99ee-58dd-450e-947a-e93450f48b32 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:24.713490 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1deb99ee-58dd-450e-947a-e93450f48b32 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:24.713929 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1deb99ee-58dd-450e-947a-e93450f48b32 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:24.714700 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1deb99ee-58dd-450e-947a-e93450f48b32 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:24.715129 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1deb99ee-58dd-450e-947a-e93450f48b32 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:24.753019 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-04ced552-e4b1-4bf4-9017-db77fb4a2020 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:24.759292 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-04ced552-e4b1-4bf4-9017-db77fb4a2020 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:24.761657 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-04ced552-e4b1-4bf4-9017-db77fb4a2020 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:24.762114 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-04ced552-e4b1-4bf4-9017-db77fb4a2020 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:24.762911 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-04ced552-e4b1-4bf4-9017-db77fb4a2020 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:24.763347 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-04ced552-e4b1-4bf4-9017-db77fb4a2020 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:24.856121 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-1deb99ee-58dd-450e-947a-e93450f48b32 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:24.871797 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-1deb99ee-58dd-450e-947a-e93450f48b32 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1735 microversion: 2.1 time: 0.169445 Jun 07 08:42:24.872986 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 261/512] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:24 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:24.911689 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-04ced552-e4b1-4bf4-9017-db77fb4a2020 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:24.919350 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-04ced552-e4b1-4bf4-9017-db77fb4a2020 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1675 microversion: 2.1 time: 0.170251 Jun 07 08:42:24.919922 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 252/513] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:24 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:42:25.896785 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-b0b89177-e9e5-4991-972d-9ed529c9af1f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:25.897413 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-b0b89177-e9e5-4991-972d-9ed529c9af1f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:25.904768 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b0b89177-e9e5-4991-972d-9ed529c9af1f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:25.905244 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b0b89177-e9e5-4991-972d-9ed529c9af1f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:25.906011 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b0b89177-e9e5-4991-972d-9ed529c9af1f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:25.906702 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b0b89177-e9e5-4991-972d-9ed529c9af1f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:25.910806 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:42:25.937720 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-2d19a0e7-4572-4377-83c7-6d2209eb4418 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:25.938307 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-2d19a0e7-4572-4377-83c7-6d2209eb4418 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:25.945602 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2d19a0e7-4572-4377-83c7-6d2209eb4418 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:25.948719 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2d19a0e7-4572-4377-83c7-6d2209eb4418 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:25.948719 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2d19a0e7-4572-4377-83c7-6d2209eb4418 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:25.948719 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2d19a0e7-4572-4377-83c7-6d2209eb4418 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:26.045266 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-b0b89177-e9e5-4991-972d-9ed529c9af1f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:26.053450 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-b0b89177-e9e5-4991-972d-9ed529c9af1f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1735 microversion: 2.1 time: 0.160798 Jun 07 08:42:26.057823 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 262/514] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:25 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:26.081713 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-2d19a0e7-4572-4377-83c7-6d2209eb4418 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:26.089917 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-2d19a0e7-4572-4377-83c7-6d2209eb4418 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1652 microversion: 2.1 time: 0.156179 Jun 07 08:42:26.090789 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 253/515] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:25 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1652 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:42:26.106758 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-e36ac9ce-a516-4596-b164-fd6db473b3d9 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:42:26.120305 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e36ac9ce-a516-4596-b164-fd6db473b3d9 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:26.120747 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e36ac9ce-a516-4596-b164-fd6db473b3d9 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:26.142678 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-e36ac9ce-a516-4596-b164-fd6db473b3d9 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Going to try to start instance {{(pid=129725) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 07 08:42:26.311332 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-e36ac9ce-a516-4596-b164-fd6db473b3d9 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "POST /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7/action" status: 202 len: 0 microversion: 2.1 time: 0.208073 Jun 07 08:42:26.311332 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 263/516] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jun 7 08:42:26 2022] POST /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 08:42:26.321840 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-7ccffe6c-06e7-43ae-b9d9-09906bb24edb tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:26.322526 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-7ccffe6c-06e7-43ae-b9d9-09906bb24edb tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:26.328615 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7ccffe6c-06e7-43ae-b9d9-09906bb24edb tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:26.332964 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7ccffe6c-06e7-43ae-b9d9-09906bb24edb tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:26.332964 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7ccffe6c-06e7-43ae-b9d9-09906bb24edb tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:26.332964 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7ccffe6c-06e7-43ae-b9d9-09906bb24edb tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:26.466338 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-7ccffe6c-06e7-43ae-b9d9-09906bb24edb tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:26.474373 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-7ccffe6c-06e7-43ae-b9d9-09906bb24edb tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1661 microversion: 2.1 time: 0.157439 Jun 07 08:42:26.474937 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 254/517] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:26 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1661 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:27.072503 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-74e64cfd-a13c-480f-845c-3d17e1e09c57 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:27.073307 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-74e64cfd-a13c-480f-845c-3d17e1e09c57 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:27.079797 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-74e64cfd-a13c-480f-845c-3d17e1e09c57 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:27.080244 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-74e64cfd-a13c-480f-845c-3d17e1e09c57 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:27.081110 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-74e64cfd-a13c-480f-845c-3d17e1e09c57 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:27.081585 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-74e64cfd-a13c-480f-845c-3d17e1e09c57 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:27.283168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-74e64cfd-a13c-480f-845c-3d17e1e09c57 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:27.291394 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-74e64cfd-a13c-480f-845c-3d17e1e09c57 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1715 microversion: 2.1 time: 0.224282 Jun 07 08:42:27.291981 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 264/518] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:27 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1715 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:27.407384 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-e4549683-59bf-4eb4-b94e-fb693aea53a1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:27.407940 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-e4549683-59bf-4eb4-b94e-fb693aea53a1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:27.414880 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e4549683-59bf-4eb4-b94e-fb693aea53a1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:27.415336 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e4549683-59bf-4eb4-b94e-fb693aea53a1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:27.416119 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e4549683-59bf-4eb4-b94e-fb693aea53a1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:27.416554 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e4549683-59bf-4eb4-b94e-fb693aea53a1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:27.492558 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-3fda323e-f83a-45a9-b3f0-f06322b74430 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:27.493593 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-3fda323e-f83a-45a9-b3f0-f06322b74430 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:27.499263 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3fda323e-f83a-45a9-b3f0-f06322b74430 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:27.500005 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3fda323e-f83a-45a9-b3f0-f06322b74430 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:27.500960 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3fda323e-f83a-45a9-b3f0-f06322b74430 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:27.501420 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3fda323e-f83a-45a9-b3f0-f06322b74430 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:27.513319 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.wsgi [None req-e4549683-59bf-4eb4-b94e-fb693aea53a1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] HTTP exception thrown: Cannot 'detach_volume' instance af1b519f-b5c9-4e6a-8413-8ce7ace3024c while it is in vm_state rescued Jun 07 08:42:27.514989 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-e4549683-59bf-4eb4-b94e-fb693aea53a1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Request method failure captured: Jun 07 08:42:27.514989 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: request: DELETE /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c/os-volume_attachments/09650d5e-d7fe-442f-ac94-0774fac75b96 HTTP/1.1 Jun 07 08:42:27.514989 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept: application/json Jun 07 08:42:27.514989 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept-Encoding: identity Jun 07 08:42:27.514989 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Connection: close Jun 07 08:42:27.514989 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Length: 0 Jun 07 08:42:27.514989 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Type: application/json Jun 07 08:42:27.514989 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Host: 10.222.0.17 Jun 07 08:42:27.514989 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Openstack-System-Scope: None Jun 07 08:42:27.514989 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: User-Agent: python-urllib3/1.26.9 Jun 07 08:42:27.514989 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Auth-Token: gAAAAABinw56gFqEMZtH-I0OxhDG-zG6My9swmCke2xrKyH-Hi3vn7-umR3bhinsgBM-VBrrIJFaQdJKLbe8_s6_ve07jIkgyhtY0t3tA8s4W3pn-RsLOgTMCSA2ud98s6n92bGn7O40KljBfpr0883mO-X5ZsF73uXRGoWztv8PfwpUy-0skp0 Jun 07 08:42:27.514989 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Id: None Jun 07 08:42:27.514989 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Name: None Jun 07 08:42:27.514989 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Identity-Status: Confirmed Jun 07 08:42:27.514989 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Is-Admin-Project: True Jun 07 08:42:27.514989 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Id: default Jun 07 08:42:27.514989 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Name: Default Jun 07 08:42:27.514989 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Id: 10b79d91933b4f7f9f32d66138e18373 Jun 07 08:42:27.514989 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-311181591 Jun 07 08:42:27.514989 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Role: reader,member Jun 07 08:42:27.514989 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Roles: reader,member Jun 07 08:42:27.516333 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/10b79d91933b4f7f9f32d66138e18373"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/10b79d91933b4f7f9f32d66138e18373"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_10b79d91933b4f7f9f32d66138e18373", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/10b79d91933b4f7f9f32d66138e18373"}]}] Jun 07 08:42:27.516333 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant: tempest-ServerRescueNegativeTestJSON-311181591 Jun 07 08:42:27.516333 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Id: 10b79d91933b4f7f9f32d66138e18373 Jun 07 08:42:27.516333 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-311181591 Jun 07 08:42:27.516333 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User: tempest-ServerRescueNegativeTestJSON-311181591-project Jun 07 08:42:27.516333 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Id: default Jun 07 08:42:27.516333 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Name: Default Jun 07 08:42:27.516333 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Id: 055ec8a54bdf400fac0a46b0e5497f1b Jun 07 08:42:27.516333 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Name: tempest-ServerRescueNegativeTestJSON-311181591-project Jun 07 08:42:27.516333 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: method: > Jun 07 08:42:27.516333 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: exception: Cannot 'detach_volume' instance af1b519f-b5c9-4e6a-8413-8ce7ace3024c while it is in vm_state rescued Jun 07 08:42:27.517045 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: action_args: {'server_id': 'af1b519f-b5c9-4e6a-8413-8ce7ace3024c', 'id': '09650d5e-d7fe-442f-ac94-0774fac75b96'} Jun 07 08:42:27.517045 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:42:27.517045 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:42:27.517045 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 07 08:42:27.517045 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 07 08:42:27.517045 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 08:42:27.517045 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 08:42:27.517045 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 07 08:42:27.517045 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 07 08:42:27.517045 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance af1b519f-b5c9-4e6a-8413-8ce7ace3024c in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 07 08:42:27.517045 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:42:27.517045 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:42:27.517045 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:42:27.517045 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:42:27.517045 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:42:27.517045 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:42:27.517045 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:42:27.517045 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:42:27.517045 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:42:27.517045 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:42:27.518853 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 07 08:42:27.518853 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 07 08:42:27.518853 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 07 08:42:27.518853 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 07 08:42:27.518853 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance af1b519f-b5c9-4e6a-8413-8ce7ace3024c while it is in vm_state rescued Jun 07 08:42:27.518853 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:42:27.518853 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:42:27.518853 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:42:27.518853 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:42:27.518853 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:42:27.518853 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:42:27.518853 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:42:27.518853 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:42:27.518853 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance af1b519f-b5c9-4e6a-8413-8ce7ace3024c while it is in vm_state rescued Jun 07 08:42:27.518853 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:42:27.518853 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-e4549683-59bf-4eb4-b94e-fb693aea53a1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Returning 409 to user: Cannot 'detach_volume' instance af1b519f-b5c9-4e6a-8413-8ce7ace3024c while it is in vm_state rescued {{(pid=129726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:42:27.519831 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-e4549683-59bf-4eb4-b94e-fb693aea53a1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "DELETE /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c/os-volume_attachments/09650d5e-d7fe-442f-ac94-0774fac75b96" status: 409 len: 152 microversion: 2.1 time: 0.113715 Jun 07 08:42:27.520729 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 255/519] 10.222.0.17 () {58 vars in 1415 bytes} [Tue Jun 7 08:42:27 2022] DELETE /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c/os-volume_attachments/09650d5e-d7fe-442f-ac94-0774fac75b96 => generated 152 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 07 08:42:27.525797 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-e2f48e26-b16a-470b-a135-b4fd9b4fe630 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:42:27.526341 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-e2f48e26-b16a-470b-a135-b4fd9b4fe630 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:27.533185 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e2f48e26-b16a-470b-a135-b4fd9b4fe630 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:27.533575 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e2f48e26-b16a-470b-a135-b4fd9b4fe630 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:27.534344 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e2f48e26-b16a-470b-a135-b4fd9b4fe630 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:27.534785 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e2f48e26-b16a-470b-a135-b4fd9b4fe630 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:27.568383 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:42:27.672579 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-3fda323e-f83a-45a9-b3f0-f06322b74430 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:27.681064 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-3fda323e-f83a-45a9-b3f0-f06322b74430 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1661 microversion: 2.1 time: 0.193156 Jun 07 08:42:27.686701 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 265/520] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:27 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1661 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:42:27.751853 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-e2f48e26-b16a-470b-a135-b4fd9b4fe630 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "POST /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c/action" status: 202 len: 0 microversion: 2.1 time: 0.229698 Jun 07 08:42:27.752541 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 256/521] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jun 7 08:42:27 2022] POST /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 08:42:27.760987 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-0055aaa2-53e1-489b-8741-c2a41a3eb684 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:27.761625 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-0055aaa2-53e1-489b-8741-c2a41a3eb684 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:27.767974 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0055aaa2-53e1-489b-8741-c2a41a3eb684 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:27.768423 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0055aaa2-53e1-489b-8741-c2a41a3eb684 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:27.769239 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0055aaa2-53e1-489b-8741-c2a41a3eb684 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:27.769677 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0055aaa2-53e1-489b-8741-c2a41a3eb684 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:27.937198 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-0055aaa2-53e1-489b-8741-c2a41a3eb684 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:27.945573 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-0055aaa2-53e1-489b-8741-c2a41a3eb684 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1723 microversion: 2.1 time: 0.188445 Jun 07 08:42:27.949965 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 266/522] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:27 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:28.700070 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-49713429-483d-4aa4-83db-417e42531ecd tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:28.700768 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-49713429-483d-4aa4-83db-417e42531ecd tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:28.707076 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-49713429-483d-4aa4-83db-417e42531ecd tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:28.707515 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-49713429-483d-4aa4-83db-417e42531ecd tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:28.708279 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-49713429-483d-4aa4-83db-417e42531ecd tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:28.708715 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-49713429-483d-4aa4-83db-417e42531ecd tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:28.858178 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-49713429-483d-4aa4-83db-417e42531ecd tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:28.869702 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-49713429-483d-4aa4-83db-417e42531ecd tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1661 microversion: 2.1 time: 0.174773 Jun 07 08:42:28.870596 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 257/523] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:28 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1661 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:28.963749 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-67e1ede1-cdbe-4c75-85fe-a92a8f31a375 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:28.964473 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-67e1ede1-cdbe-4c75-85fe-a92a8f31a375 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:28.971184 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-67e1ede1-cdbe-4c75-85fe-a92a8f31a375 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:28.971636 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-67e1ede1-cdbe-4c75-85fe-a92a8f31a375 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:28.972408 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-67e1ede1-cdbe-4c75-85fe-a92a8f31a375 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:28.972847 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-67e1ede1-cdbe-4c75-85fe-a92a8f31a375 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:29.104697 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-67e1ede1-cdbe-4c75-85fe-a92a8f31a375 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:29.112707 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-67e1ede1-cdbe-4c75-85fe-a92a8f31a375 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1723 microversion: 2.1 time: 0.153056 Jun 07 08:42:29.113321 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 267/524] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:28 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:29.887645 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-2907267e-3425-474e-b76a-48591f8cd338 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:29.888233 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-2907267e-3425-474e-b76a-48591f8cd338 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:29.894788 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2907267e-3425-474e-b76a-48591f8cd338 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:29.895237 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2907267e-3425-474e-b76a-48591f8cd338 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:29.895993 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2907267e-3425-474e-b76a-48591f8cd338 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:29.896429 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2907267e-3425-474e-b76a-48591f8cd338 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:30.023740 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-2907267e-3425-474e-b76a-48591f8cd338 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:30.031480 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-2907267e-3425-474e-b76a-48591f8cd338 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1665 microversion: 2.1 time: 0.147518 Jun 07 08:42:30.032036 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 258/525] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:29 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1665 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:30.130796 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-dff840d0-e849-4463-8cbf-d98fa9b6fb55 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:30.131451 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-dff840d0-e849-4463-8cbf-d98fa9b6fb55 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:30.137992 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-dff840d0-e849-4463-8cbf-d98fa9b6fb55 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:30.138382 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-dff840d0-e849-4463-8cbf-d98fa9b6fb55 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:30.139175 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-dff840d0-e849-4463-8cbf-d98fa9b6fb55 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:30.139606 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-dff840d0-e849-4463-8cbf-d98fa9b6fb55 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:30.270297 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-dff840d0-e849-4463-8cbf-d98fa9b6fb55 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:30.278747 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-dff840d0-e849-4463-8cbf-d98fa9b6fb55 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1723 microversion: 2.1 time: 0.151878 Jun 07 08:42:30.279303 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 268/526] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:30 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:31.296392 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-017d8572-6dfc-45d5-840a-46ac2a203d8e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:31.297036 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-017d8572-6dfc-45d5-840a-46ac2a203d8e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:31.303471 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-017d8572-6dfc-45d5-840a-46ac2a203d8e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:31.304552 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-017d8572-6dfc-45d5-840a-46ac2a203d8e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:31.305333 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-017d8572-6dfc-45d5-840a-46ac2a203d8e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:31.305773 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-017d8572-6dfc-45d5-840a-46ac2a203d8e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:31.435461 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-017d8572-6dfc-45d5-840a-46ac2a203d8e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:31.443398 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-017d8572-6dfc-45d5-840a-46ac2a203d8e tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1723 microversion: 2.1 time: 0.150877 Jun 07 08:42:31.443901 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 259/527] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:31 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:32.460429 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-73e7a92d-97d5-48fd-98f0-4a0dd41f2e7f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:32.461922 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-73e7a92d-97d5-48fd-98f0-4a0dd41f2e7f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:32.467505 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-73e7a92d-97d5-48fd-98f0-4a0dd41f2e7f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:32.467954 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-73e7a92d-97d5-48fd-98f0-4a0dd41f2e7f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:32.468706 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-73e7a92d-97d5-48fd-98f0-4a0dd41f2e7f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:32.469174 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-73e7a92d-97d5-48fd-98f0-4a0dd41f2e7f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:32.596134 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-73e7a92d-97d5-48fd-98f0-4a0dd41f2e7f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:32.603973 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-73e7a92d-97d5-48fd-98f0-4a0dd41f2e7f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1729 microversion: 2.1 time: 0.147409 Jun 07 08:42:32.604535 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 269/528] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:32 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1729 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:32.620891 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-df1a8ac2-7323-4c4a-ad5e-8b20268a97da tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:32.621447 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-df1a8ac2-7323-4c4a-ad5e-8b20268a97da tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:32.627825 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-df1a8ac2-7323-4c4a-ad5e-8b20268a97da tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:32.628268 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-df1a8ac2-7323-4c4a-ad5e-8b20268a97da tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:32.629028 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-df1a8ac2-7323-4c4a-ad5e-8b20268a97da tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:32.629467 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-df1a8ac2-7323-4c4a-ad5e-8b20268a97da tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:32.704255 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-df1a8ac2-7323-4c4a-ad5e-8b20268a97da tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087671 Jun 07 08:42:32.704839 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 260/529] 10.222.0.17 () {58 vars in 1274 bytes} [Tue Jun 7 08:42:32 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:42:33.624405 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-bc54ae93-77f3-452d-9c96-4e919a457eb2 req-a4715ac3-d4ea-48cd-b85c-bb9b2a63f85a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af1b519f-b5c9-4e6a-8413-8ce7ace3024c", "tag": "888115bf-712f-4cb1-b6a5-86649fc08594"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:42:33.647401 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-bc54ae93-77f3-452d-9c96-4e919a457eb2 req-a4715ac3-d4ea-48cd-b85c-bb9b2a63f85a service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:33.647401 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-bc54ae93-77f3-452d-9c96-4e919a457eb2 req-a4715ac3-d4ea-48cd-b85c-bb9b2a63f85a service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:33.660575 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-bc54ae93-77f3-452d-9c96-4e919a457eb2 req-a4715ac3-d4ea-48cd-b85c-bb9b2a63f85a service nova] Creating event network-changed:888115bf-712f-4cb1-b6a5-86649fc08594 for instance af1b519f-b5c9-4e6a-8413-8ce7ace3024c on hv-cinder-74014 Jun 07 08:42:33.662850 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-bc54ae93-77f3-452d-9c96-4e919a457eb2 req-a4715ac3-d4ea-48cd-b85c-bb9b2a63f85a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041970 Jun 07 08:42:33.664465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 270/530] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:42:35.677674 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-72ce4fa4-ec5f-46a5-989a-986741e1547b req-70d2f62b-5999-40b6-868a-43247786462c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af1b519f-b5c9-4e6a-8413-8ce7ace3024c", "tag": "888115bf-712f-4cb1-b6a5-86649fc08594"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:42:35.686288 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-72ce4fa4-ec5f-46a5-989a-986741e1547b req-70d2f62b-5999-40b6-868a-43247786462c service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:35.686729 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-72ce4fa4-ec5f-46a5-989a-986741e1547b req-70d2f62b-5999-40b6-868a-43247786462c service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:35.698141 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-72ce4fa4-ec5f-46a5-989a-986741e1547b req-70d2f62b-5999-40b6-868a-43247786462c service nova] Creating event network-changed:888115bf-712f-4cb1-b6a5-86649fc08594 for instance af1b519f-b5c9-4e6a-8413-8ce7ace3024c on hv-cinder-74014 Jun 07 08:42:35.703219 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-72ce4fa4-ec5f-46a5-989a-986741e1547b req-70d2f62b-5999-40b6-868a-43247786462c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029743 Jun 07 08:42:35.703846 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 261/531] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:42:39.578600 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-a2da43fd-59c1-42a7-ab85-f9d6792feeb6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:39.579573 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-a2da43fd-59c1-42a7-ab85-f9d6792feeb6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:39.586313 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a2da43fd-59c1-42a7-ab85-f9d6792feeb6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:39.589625 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a2da43fd-59c1-42a7-ab85-f9d6792feeb6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:39.589625 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a2da43fd-59c1-42a7-ab85-f9d6792feeb6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:39.589625 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a2da43fd-59c1-42a7-ab85-f9d6792feeb6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:39.620489 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-a2da43fd-59c1-42a7-ab85-f9d6792feeb6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad/os-volume_attachments/cd11eb86-22c5-4a53-ac80-4552d81f2b2e" status: 200 len: 194 microversion: 2.20 time: 0.047090 Jun 07 08:42:39.621086 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 271/532] 10.222.0.17 () {60 vars in 1453 bytes} [Tue Jun 7 08:42:39 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad/os-volume_attachments/cd11eb86-22c5-4a53-ac80-4552d81f2b2e => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 08:42:39.685065 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-73ba1124-2729-4339-88b3-11205934a755 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:39.685847 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-73ba1124-2729-4339-88b3-11205934a755 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:39.693693 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-73ba1124-2729-4339-88b3-11205934a755 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:39.697690 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-73ba1124-2729-4339-88b3-11205934a755 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:39.697690 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-73ba1124-2729-4339-88b3-11205934a755 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:39.697690 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-73ba1124-2729-4339-88b3-11205934a755 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:39.785831 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.objects.instance [None req-73ba1124-2729-4339-88b3-11205934a755 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lazy-loading 'services' on Instance uuid 60630f0f-2831-479d-91fc-477b773635ad {{(pid=129726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:42:40.045064 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-73ba1124-2729-4339-88b3-11205934a755 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "DELETE /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad/os-volume_attachments/cd11eb86-22c5-4a53-ac80-4552d81f2b2e" status: 202 len: 0 microversion: 2.20 time: 0.366358 Jun 07 08:42:40.045672 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 262/533] 10.222.0.17 () {60 vars in 1456 bytes} [Tue Jun 7 08:42:39 2022] DELETE /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad/os-volume_attachments/cd11eb86-22c5-4a53-ac80-4552d81f2b2e => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 08:42:40.055149 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-8544704e-3557-4bee-8c16-cadfb278290e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:40.056444 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-8544704e-3557-4bee-8c16-cadfb278290e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:40.064061 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8544704e-3557-4bee-8c16-cadfb278290e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:40.064573 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8544704e-3557-4bee-8c16-cadfb278290e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:40.067192 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8544704e-3557-4bee-8c16-cadfb278290e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:40.067192 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8544704e-3557-4bee-8c16-cadfb278290e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:40.101119 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-8544704e-3557-4bee-8c16-cadfb278290e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050203 Jun 07 08:42:40.105588 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 272/534] 10.222.0.17 () {60 vars in 1342 bytes} [Tue Jun 7 08:42:40 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 08:42:40.281988 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-c86163af-4335-4f47-b30e-e06dcf5742b9 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:42:40.282951 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-c86163af-4335-4f47-b30e-e06dcf5742b9 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:40.289295 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c86163af-4335-4f47-b30e-e06dcf5742b9 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:40.289752 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c86163af-4335-4f47-b30e-e06dcf5742b9 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:40.290539 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c86163af-4335-4f47-b30e-e06dcf5742b9 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:40.290977 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c86163af-4335-4f47-b30e-e06dcf5742b9 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:40.677582 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-c86163af-4335-4f47-b30e-e06dcf5742b9 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "POST /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db/action" status: 202 len: 0 microversion: 2.1 time: 0.400058 Jun 07 08:42:40.678939 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 263/535] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jun 7 08:42:40 2022] POST /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 08:42:40.687518 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-5b56295d-33d0-40ab-9272-7c9dcd7038ac tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:40.688252 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-5b56295d-33d0-40ab-9272-7c9dcd7038ac tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:40.696799 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5b56295d-33d0-40ab-9272-7c9dcd7038ac tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:40.697277 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5b56295d-33d0-40ab-9272-7c9dcd7038ac tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:40.698172 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5b56295d-33d0-40ab-9272-7c9dcd7038ac tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:40.698673 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5b56295d-33d0-40ab-9272-7c9dcd7038ac tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:40.864494 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-5b56295d-33d0-40ab-9272-7c9dcd7038ac tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:40.874707 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-5b56295d-33d0-40ab-9272-7c9dcd7038ac tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1750 microversion: 2.1 time: 0.191286 Jun 07 08:42:40.875755 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 273/536] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:40 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1750 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:41.114319 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-10f95b5e-52b8-4831-b223-afde5a40d5d1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:41.115379 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-10f95b5e-52b8-4831-b223-afde5a40d5d1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:41.118850 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_api:SELECT=50 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:42:41.124292 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-10f95b5e-52b8-4831-b223-afde5a40d5d1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:41.124872 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-10f95b5e-52b8-4831-b223-afde5a40d5d1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:41.125784 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-10f95b5e-52b8-4831-b223-afde5a40d5d1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:41.126401 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-10f95b5e-52b8-4831-b223-afde5a40d5d1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:41.161824 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-10f95b5e-52b8-4831-b223-afde5a40d5d1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051866 Jun 07 08:42:41.162435 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 264/537] 10.222.0.17 () {60 vars in 1342 bytes} [Tue Jun 7 08:42:41 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 08:42:41.895125 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-41a0726e-c72d-468f-8790-504c0b72066e tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:41.895770 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-41a0726e-c72d-468f-8790-504c0b72066e tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:41.902574 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-41a0726e-c72d-468f-8790-504c0b72066e tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:41.903025 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-41a0726e-c72d-468f-8790-504c0b72066e tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:41.904710 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-41a0726e-c72d-468f-8790-504c0b72066e tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:41.904710 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-41a0726e-c72d-468f-8790-504c0b72066e tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:42.053758 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-41a0726e-c72d-468f-8790-504c0b72066e tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:42.061909 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-41a0726e-c72d-468f-8790-504c0b72066e tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1755 microversion: 2.1 time: 0.170722 Jun 07 08:42:42.062479 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 274/538] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:41 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:42:42.174168 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-6c426584-a0e4-451e-a4a1-456a5bcf4928 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:42.175065 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-6c426584-a0e4-451e-a4a1-456a5bcf4928 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:42.182547 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6c426584-a0e4-451e-a4a1-456a5bcf4928 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:42.183025 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6c426584-a0e4-451e-a4a1-456a5bcf4928 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:42.183753 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6c426584-a0e4-451e-a4a1-456a5bcf4928 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:42.184182 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6c426584-a0e4-451e-a4a1-456a5bcf4928 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:42.216799 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-6c426584-a0e4-451e-a4a1-456a5bcf4928 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046318 Jun 07 08:42:42.217618 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 265/539] 10.222.0.17 () {60 vars in 1342 bytes} [Tue Jun 7 08:42:42 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:42.275668 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-43259306-11c2-4fc9-b038-f07eef627312 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:42.276229 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-43259306-11c2-4fc9-b038-f07eef627312 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:42.282807 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-43259306-11c2-4fc9-b038-f07eef627312 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:42.283420 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-43259306-11c2-4fc9-b038-f07eef627312 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:42.284281 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-43259306-11c2-4fc9-b038-f07eef627312 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:42.284777 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-43259306-11c2-4fc9-b038-f07eef627312 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:42.312465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-43259306-11c2-4fc9-b038-f07eef627312 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Going to try to terminate instance {{(pid=129725) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 08:42:42.628292 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-43259306-11c2-4fc9-b038-f07eef627312 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "DELETE /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 204 len: 0 microversion: 2.20 time: 0.356537 Jun 07 08:42:42.628795 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 275/540] 10.222.0.17 () {60 vars in 1279 bytes} [Tue Jun 7 08:42:42 2022] DELETE /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 07 08:42:42.637089 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-3677f92c-09a0-4d4f-8961-172e37165eac tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:42.637704 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-3677f92c-09a0-4d4f-8961-172e37165eac tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:42.643951 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3677f92c-09a0-4d4f-8961-172e37165eac tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:42.648186 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3677f92c-09a0-4d4f-8961-172e37165eac tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:42.648186 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3677f92c-09a0-4d4f-8961-172e37165eac tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:42.648186 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3677f92c-09a0-4d4f-8961-172e37165eac tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:42.779330 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-3677f92c-09a0-4d4f-8961-172e37165eac tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:42.787417 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-3677f92c-09a0-4d4f-8961-172e37165eac tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:42.789511 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-3677f92c-09a0-4d4f-8961-172e37165eac tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:42.790652 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-3677f92c-09a0-4d4f-8961-172e37165eac tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1724 microversion: 2.20 time: 0.157564 Jun 07 08:42:42.791202 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 266/541] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:42:42 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:42:43.083063 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-2899c6c5-d5ce-45d8-b826-09b481688ce2 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:43.083779 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-2899c6c5-d5ce-45d8-b826-09b481688ce2 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:43.091800 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2899c6c5-d5ce-45d8-b826-09b481688ce2 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:43.092331 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2899c6c5-d5ce-45d8-b826-09b481688ce2 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:43.093159 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2899c6c5-d5ce-45d8-b826-09b481688ce2 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:43.093870 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2899c6c5-d5ce-45d8-b826-09b481688ce2 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:43.243275 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-2899c6c5-d5ce-45d8-b826-09b481688ce2 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:43.245797 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:42:43.253065 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-2899c6c5-d5ce-45d8-b826-09b481688ce2 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1755 microversion: 2.1 time: 0.175016 Jun 07 08:42:43.253696 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 276/542] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:43 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:43.809578 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-d1c0554e-ef84-46fd-8c76-3128e2e79bd8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:43.810125 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-d1c0554e-ef84-46fd-8c76-3128e2e79bd8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:43.816539 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d1c0554e-ef84-46fd-8c76-3128e2e79bd8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:43.816986 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d1c0554e-ef84-46fd-8c76-3128e2e79bd8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:43.817769 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d1c0554e-ef84-46fd-8c76-3128e2e79bd8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:43.818210 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d1c0554e-ef84-46fd-8c76-3128e2e79bd8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:43.951438 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-d1c0554e-ef84-46fd-8c76-3128e2e79bd8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:43.959651 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-d1c0554e-ef84-46fd-8c76-3128e2e79bd8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:43.961218 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-d1c0554e-ef84-46fd-8c76-3128e2e79bd8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:43.962374 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-d1c0554e-ef84-46fd-8c76-3128e2e79bd8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1724 microversion: 2.20 time: 0.156742 Jun 07 08:42:43.962942 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 267/543] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:42:43 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:42:44.276723 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-117dd7b2-a47e-46eb-82f1-225ae7c72642 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:44.284407 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-117dd7b2-a47e-46eb-82f1-225ae7c72642 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:44.284830 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-117dd7b2-a47e-46eb-82f1-225ae7c72642 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:44.285376 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-117dd7b2-a47e-46eb-82f1-225ae7c72642 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:44.286070 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-117dd7b2-a47e-46eb-82f1-225ae7c72642 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:44.286505 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-117dd7b2-a47e-46eb-82f1-225ae7c72642 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:44.485154 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-117dd7b2-a47e-46eb-82f1-225ae7c72642 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:44.491830 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-117dd7b2-a47e-46eb-82f1-225ae7c72642 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1755 microversion: 2.1 time: 0.219625 Jun 07 08:42:44.492404 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 277/544] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:44 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1755 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:44.982491 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-79852804-741a-480a-915b-897484abf13e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:44.983388 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-79852804-741a-480a-915b-897484abf13e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:44.990020 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-79852804-741a-480a-915b-897484abf13e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:44.990493 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-79852804-741a-480a-915b-897484abf13e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:44.991852 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-79852804-741a-480a-915b-897484abf13e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:44.992317 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-79852804-741a-480a-915b-897484abf13e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:45.130397 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-79852804-741a-480a-915b-897484abf13e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:45.138826 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-79852804-741a-480a-915b-897484abf13e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:45.140545 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-79852804-741a-480a-915b-897484abf13e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:45.141935 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-79852804-741a-480a-915b-897484abf13e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1724 microversion: 2.20 time: 0.163376 Jun 07 08:42:45.142476 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 268/545] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:42:44 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:42:45.400795 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-62d87a04-46b6-4045-b030-b24a5c366e1e req-0b907ccb-cb25-40ec-93b2-135a56c1472a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60630f0f-2831-479d-91fc-477b773635ad", "name": "network-vif-deleted", "tag": "87bcbdda-ce88-44b8-b537-66a7d29ac04f"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:42:45.410316 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-62d87a04-46b6-4045-b030-b24a5c366e1e req-0b907ccb-cb25-40ec-93b2-135a56c1472a service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:45.413776 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-62d87a04-46b6-4045-b030-b24a5c366e1e req-0b907ccb-cb25-40ec-93b2-135a56c1472a service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:45.422827 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-62d87a04-46b6-4045-b030-b24a5c366e1e req-0b907ccb-cb25-40ec-93b2-135a56c1472a service nova] Creating event network-vif-deleted:87bcbdda-ce88-44b8-b537-66a7d29ac04f for instance 60630f0f-2831-479d-91fc-477b773635ad on hv-cinder-74014 Jun 07 08:42:45.427665 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-62d87a04-46b6-4045-b030-b24a5c366e1e req-0b907ccb-cb25-40ec-93b2-135a56c1472a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031440 Jun 07 08:42:45.428249 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 278/546] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:42:45.513610 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-30a05e8f-0a77-4cc2-89bb-a00774b499df tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:45.514263 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-30a05e8f-0a77-4cc2-89bb-a00774b499df tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:45.520653 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-30a05e8f-0a77-4cc2-89bb-a00774b499df tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:45.521134 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-30a05e8f-0a77-4cc2-89bb-a00774b499df tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:45.522866 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-30a05e8f-0a77-4cc2-89bb-a00774b499df tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:45.523276 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-30a05e8f-0a77-4cc2-89bb-a00774b499df tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:45.690147 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-30a05e8f-0a77-4cc2-89bb-a00774b499df tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:45.700825 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-30a05e8f-0a77-4cc2-89bb-a00774b499df tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1755 microversion: 2.1 time: 0.192046 Jun 07 08:42:45.701545 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 269/547] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:45 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1755 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:46.161995 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-626866a2-a581-48d9-be34-a29b3bf80064 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:46.162851 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-626866a2-a581-48d9-be34-a29b3bf80064 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:46.169460 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-626866a2-a581-48d9-be34-a29b3bf80064 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:46.169843 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-626866a2-a581-48d9-be34-a29b3bf80064 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:46.170612 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-626866a2-a581-48d9-be34-a29b3bf80064 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:46.171045 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-626866a2-a581-48d9-be34-a29b3bf80064 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:46.207821 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-626866a2-a581-48d9-be34-a29b3bf80064 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:46.208519 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-626866a2-a581-48d9-be34-a29b3bf80064 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:46.208982 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.objects.instance [None req-626866a2-a581-48d9-be34-a29b3bf80064 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lazy-loading 'fault' on Instance uuid 60630f0f-2831-479d-91fc-477b773635ad {{(pid=129725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:42:46.255233 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-626866a2-a581-48d9-be34-a29b3bf80064 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:46.265597 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-626866a2-a581-48d9-be34-a29b3bf80064 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:46.267692 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-626866a2-a581-48d9-be34-a29b3bf80064 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:46.269260 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-626866a2-a581-48d9-be34-a29b3bf80064 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 200 len: 1372 microversion: 2.20 time: 0.111715 Jun 07 08:42:46.277145 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 279/548] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:42:46 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 1372 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:42:46.719919 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-1f1f21d6-258c-4270-be5f-bc16e9b94a0d tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:46.720971 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-1f1f21d6-258c-4270-be5f-bc16e9b94a0d tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:46.727513 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1f1f21d6-258c-4270-be5f-bc16e9b94a0d tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:46.727958 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1f1f21d6-258c-4270-be5f-bc16e9b94a0d tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:46.728722 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1f1f21d6-258c-4270-be5f-bc16e9b94a0d tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:46.729199 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1f1f21d6-258c-4270-be5f-bc16e9b94a0d tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:46.878759 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-1f1f21d6-258c-4270-be5f-bc16e9b94a0d tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:46.888006 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-1f1f21d6-258c-4270-be5f-bc16e9b94a0d tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1755 microversion: 2.1 time: 0.171817 Jun 07 08:42:46.888547 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 270/549] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:46 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:47.288449 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-d4116208-7ded-486a-a402-d7538a7bc1bd tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:47.289088 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-d4116208-7ded-486a-a402-d7538a7bc1bd tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:47.295577 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d4116208-7ded-486a-a402-d7538a7bc1bd tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:47.296021 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d4116208-7ded-486a-a402-d7538a7bc1bd tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:47.296780 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d4116208-7ded-486a-a402-d7538a7bc1bd tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:47.297231 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d4116208-7ded-486a-a402-d7538a7bc1bd tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:47.315191 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.wsgi [None req-d4116208-7ded-486a-a402-d7538a7bc1bd tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] HTTP exception thrown: Instance 60630f0f-2831-479d-91fc-477b773635ad could not be found. Jun 07 08:42:47.317092 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-d4116208-7ded-486a-a402-d7538a7bc1bd tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Request method failure captured: Jun 07 08:42:47.317092 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: request: GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad HTTP/1.1 Jun 07 08:42:47.317092 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept: application/json Jun 07 08:42:47.317092 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept-Encoding: identity Jun 07 08:42:47.317092 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Connection: close Jun 07 08:42:47.317092 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Length: 0 Jun 07 08:42:47.317092 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Type: application/json Jun 07 08:42:47.317092 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Host: 10.222.0.17 Jun 07 08:42:47.317092 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Openstack-System-Scope: None Jun 07 08:42:47.317092 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: User-Agent: python-urllib3/1.26.9 Jun 07 08:42:47.317092 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Auth-Token: gAAAAABinw6AMDrD6cpFa2nDBfKc0fThvicVKBoLZUEL8r-4EbliQlPvbonCatBIRBx6E4P03AiGn4hedL8iaoBeIGYveD1pWEpC0yEaVu0Q4UuUP3RKZeAc6TrfwxZeJ9ULbzTvdDfB3z6t0xdHyYS1_6RGk71dFO4RtIM0K8aToU9kRTECu6g Jun 07 08:42:47.317092 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Id: None Jun 07 08:42:47.317092 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Name: None Jun 07 08:42:47.317092 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Identity-Status: Confirmed Jun 07 08:42:47.317092 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Is-Admin-Project: True Jun 07 08:42:47.317092 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 08:42:47.317092 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Id: default Jun 07 08:42:47.317092 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Name: Default Jun 07 08:42:47.317092 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Id: 4f25f022755d465fac40f2681eaef0a5 Jun 07 08:42:47.317092 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1415936952 Jun 07 08:42:47.317092 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Role: reader,member Jun 07 08:42:47.317092 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Roles: reader,member Jun 07 08:42:47.318794 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4f25f022755d465fac40f2681eaef0a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4f25f022755d465fac40f2681eaef0a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4f25f022755d465fac40f2681eaef0a5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4f25f022755d465fac40f2681eaef0a5"}]}] Jun 07 08:42:47.318794 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1415936952 Jun 07 08:42:47.318794 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Id: 4f25f022755d465fac40f2681eaef0a5 Jun 07 08:42:47.318794 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1415936952 Jun 07 08:42:47.318794 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User: tempest-AttachVolumeShelveTestJSON-1415936952-project Jun 07 08:42:47.318794 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Id: default Jun 07 08:42:47.318794 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Name: Default Jun 07 08:42:47.318794 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Id: 0b2efb9857cf495f8b51a96b5f868d44 Jun 07 08:42:47.318794 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1415936952-project Jun 07 08:42:47.318794 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: method: > Jun 07 08:42:47.318794 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: exception: Instance 60630f0f-2831-479d-91fc-477b773635ad could not be found. Jun 07 08:42:47.318794 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: action_args: {'id': '60630f0f-2831-479d-91fc-477b773635ad'} Jun 07 08:42:47.319853 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:42:47.319853 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:42:47.319853 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:42:47.319853 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:42:47.319853 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:42:47.319853 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:42:47.319853 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:42:47.319853 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:42:47.319853 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:42:47.319853 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:42:47.319853 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60630f0f-2831-479d-91fc-477b773635ad could not be found. Jun 07 08:42:47.319853 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:42:47.319853 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:42:47.319853 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:42:47.319853 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:42:47.319853 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:42:47.319853 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:42:47.319853 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:42:47.319853 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:42:47.319853 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:42:47.321443 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:42:47.321443 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 08:42:47.321443 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 08:42:47.321443 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:42:47.321443 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:42:47.321443 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:42:47.321443 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:42:47.321443 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60630f0f-2831-479d-91fc-477b773635ad could not be found. Jun 07 08:42:47.321443 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:42:47.321443 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:42:47.321443 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:42:47.321443 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:42:47.321443 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:42:47.321443 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:42:47.321443 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:42:47.321443 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:42:47.321443 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60630f0f-2831-479d-91fc-477b773635ad could not be found. Jun 07 08:42:47.321443 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:42:47.323045 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-d4116208-7ded-486a-a402-d7538a7bc1bd tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Returning 404 to user: Instance 60630f0f-2831-479d-91fc-477b773635ad could not be found. {{(pid=129725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:42:47.323045 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-d4116208-7ded-486a-a402-d7538a7bc1bd tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 404 len: 111 microversion: 2.20 time: 0.034556 Jun 07 08:42:47.323045 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 280/550] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:42:47 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 08:42:47.329282 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-a051fb54-2e85-40a2-8ea2-ef18189e1e91 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '.version_select at 0x7f7fecbeaca0>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:47.429695 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-a051fb54-2e85-40a2-8ea2-ef18189e1e91 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1412436988" status: 204 len: 0 microversion: 2.20 time: 0.105044 Jun 07 08:42:47.430281 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 271/551] 10.222.0.17 () {60 vars in 1261 bytes} [Tue Jun 7 08:42:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1412436988 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 07 08:42:47.905817 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-6f1064bf-19d6-4316-bf5d-77ddbc0f3b1b tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:47.906440 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-6f1064bf-19d6-4316-bf5d-77ddbc0f3b1b tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:47.912383 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6f1064bf-19d6-4316-bf5d-77ddbc0f3b1b tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:47.913379 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6f1064bf-19d6-4316-bf5d-77ddbc0f3b1b tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:47.914373 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6f1064bf-19d6-4316-bf5d-77ddbc0f3b1b tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:47.914787 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6f1064bf-19d6-4316-bf5d-77ddbc0f3b1b tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:48.074620 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-6f1064bf-19d6-4316-bf5d-77ddbc0f3b1b tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:48.084325 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-6f1064bf-19d6-4316-bf5d-77ddbc0f3b1b tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1755 microversion: 2.1 time: 0.182695 Jun 07 08:42:48.085740 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 281/552] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:47 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:48.293558 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-a17d772d-e996-4939-a1fc-39bfb43435c2 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Action: 'create', calling method: .version_select at 0x7f7fecb31550>, body: {"keypair": {"name": "tempest-keypair-1267913270", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGomBMM65aMXKsFNqX7vM2wKDRxWczPPApySiD/nYaSNTO39U0w1hL1/uzBTz6SWuqKHqW8n9LDt4JO38L3ak5WUDloRTzTO2Ff73pMW5TjFHDx7OCHFXWPsAGgKnlPo6Q=="}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:42:48.309577 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-a17d772d-e996-4939-a1fc-39bfb43435c2 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Getting quotas for project 4f25f022755d465fac40f2681eaef0a5. Resources: {'key_pairs'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 08:42:48.313706 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-a17d772d-e996-4939-a1fc-39bfb43435c2 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Getting quotas for user 0b2efb9857cf495f8b51a96b5f868d44 and project 4f25f022755d465fac40f2681eaef0a5. Resources: {'key_pairs'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 08:42:48.424003 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-a17d772d-e996-4939-a1fc-39bfb43435c2 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.134936 Jun 07 08:42:48.424635 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 272/553] 10.222.0.17 () {62 vars in 1199 bytes} [Tue Jun 7 08:42:48 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 136 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 07 08:42:49.107558 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-57eb1ab2-2f80-453b-995b-ab389436bfb0 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:49.108273 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-57eb1ab2-2f80-453b-995b-ab389436bfb0 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:49.114845 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-57eb1ab2-2f80-453b-995b-ab389436bfb0 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:49.115290 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-57eb1ab2-2f80-453b-995b-ab389436bfb0 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:49.116116 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-57eb1ab2-2f80-453b-995b-ab389436bfb0 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:49.116563 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-57eb1ab2-2f80-453b-995b-ab389436bfb0 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:49.280729 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-57eb1ab2-2f80-453b-995b-ab389436bfb0 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:49.289717 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-57eb1ab2-2f80-453b-995b-ab389436bfb0 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1755 microversion: 2.1 time: 0.186187 Jun 07 08:42:49.290281 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 282/554] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:49 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1755 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:50.308045 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-8be057fc-0a39-4ff7-9727-036c8eb8eb2b tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:50.308661 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-8be057fc-0a39-4ff7-9727-036c8eb8eb2b tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:50.314732 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8be057fc-0a39-4ff7-9727-036c8eb8eb2b tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:50.315108 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8be057fc-0a39-4ff7-9727-036c8eb8eb2b tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:50.315872 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8be057fc-0a39-4ff7-9727-036c8eb8eb2b tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:50.316311 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8be057fc-0a39-4ff7-9727-036c8eb8eb2b tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:50.533767 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-8be057fc-0a39-4ff7-9727-036c8eb8eb2b tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:50.538845 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:42:50.545102 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-8be057fc-0a39-4ff7-9727-036c8eb8eb2b tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1755 microversion: 2.1 time: 0.241283 Jun 07 08:42:50.545880 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 273/555] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:50 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1755 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:51.046095 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-15640534-7d1b-4943-983e-98292591ae71 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1463165084", "imageRef": "c04b0a92-7675-47c3-bcc2-8a2a59b997c3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "75f0c9b9-dc0c-407e-bed7-e83c2052dc04"}], "security_groups": [{"name": "tempest-securitygroup--419895967"}], "key_name": "tempest-keypair-1267913270", "user_data": "}} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:42:51.151337 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.network.neutron [None req-15640534-7d1b-4943-983e-98292591ae71 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] validate_networks() for [('75f0c9b9-dc0c-407e-bed7-e83c2052dc04', None, None, None, None, None)] {{(pid=129725) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 08:42:51.517915 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-15640534-7d1b-4943-983e-98292591ae71 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Flavor limits 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 08:42:51.518410 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-15640534-7d1b-4943-983e-98292591ae71 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Image limits 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 08:42:51.518930 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-15640534-7d1b-4943-983e-98292591ae71 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Flavor pref 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 08:42:51.519338 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-15640534-7d1b-4943-983e-98292591ae71 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Image pref 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 08:42:51.519749 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-15640534-7d1b-4943-983e-98292591ae71 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 08:42:51.528606 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-15640534-7d1b-4943-983e-98292591ae71 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:51.529076 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-15640534-7d1b-4943-983e-98292591ae71 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:51.529871 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-15640534-7d1b-4943-983e-98292591ae71 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:51.530308 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-15640534-7d1b-4943-983e-98292591ae71 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:51.547696 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.quota [None req-15640534-7d1b-4943-983e-98292591ae71 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Getting quotas for project 4f25f022755d465fac40f2681eaef0a5. Resources: {'ram', 'cores', 'instances'} {{(pid=129725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 08:42:51.551658 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.quota [None req-15640534-7d1b-4943-983e-98292591ae71 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Getting quotas for user 0b2efb9857cf495f8b51a96b5f868d44 and project 4f25f022755d465fac40f2681eaef0a5. Resources: {'ram', 'cores', 'instances'} {{(pid=129725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 08:42:51.564069 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-15640534-7d1b-4943-983e-98292591ae71 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Going to run 1 instances... {{(pid=129725) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 08:42:51.566043 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-8d136421-2125-414e-8c1b-4bcfa123e70a tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:51.566777 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-8d136421-2125-414e-8c1b-4bcfa123e70a tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:51.567214 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-15640534-7d1b-4943-983e-98292591ae71 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c04b0a92-7675-47c3-bcc2-8a2a59b997c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 08:42:51.573797 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8d136421-2125-414e-8c1b-4bcfa123e70a tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:51.574242 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8d136421-2125-414e-8c1b-4bcfa123e70a tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:51.575014 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8d136421-2125-414e-8c1b-4bcfa123e70a tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:51.575735 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8d136421-2125-414e-8c1b-4bcfa123e70a tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:51.689069 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-15640534-7d1b-4943-983e-98292591ae71 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.647068 Jun 07 08:42:51.690351 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 283/556] 10.222.0.17 () {62 vars in 1187 bytes} [Tue Jun 7 08:42:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 07 08:42:51.704827 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-8a4643e2-d526-4a8a-ae8f-4928002910af tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:51.706238 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-8a4643e2-d526-4a8a-ae8f-4928002910af tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:51.729642 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-8d136421-2125-414e-8c1b-4bcfa123e70a tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:51.739091 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-8d136421-2125-414e-8c1b-4bcfa123e70a tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1755 microversion: 2.1 time: 0.176715 Jun 07 08:42:51.739671 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 274/557] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:51 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:42:51.784386 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-8a4643e2-d526-4a8a-ae8f-4928002910af tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:51.795174 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-8a4643e2-d526-4a8a-ae8f-4928002910af tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:51.796860 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-8a4643e2-d526-4a8a-ae8f-4928002910af tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:51.797990 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-8a4643e2-d526-4a8a-ae8f-4928002910af tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1282 microversion: 2.20 time: 0.100541 Jun 07 08:42:51.798547 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 284/558] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:42:51 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1282 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:42:52.763918 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-b05162e8-0704-46a9-a434-0fdb754641cd tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:52.764529 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-b05162e8-0704-46a9-a434-0fdb754641cd tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:52.771188 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b05162e8-0704-46a9-a434-0fdb754641cd tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:52.771642 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b05162e8-0704-46a9-a434-0fdb754641cd tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:52.772911 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b05162e8-0704-46a9-a434-0fdb754641cd tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:52.773373 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b05162e8-0704-46a9-a434-0fdb754641cd tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:52.820245 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-fb02f5d5-038e-46bf-94d9-c73b97f75f80 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:52.820961 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-fb02f5d5-038e-46bf-94d9-c73b97f75f80 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:52.828591 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-fb02f5d5-038e-46bf-94d9-c73b97f75f80 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:52.829132 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-fb02f5d5-038e-46bf-94d9-c73b97f75f80 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:52.829982 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-fb02f5d5-038e-46bf-94d9-c73b97f75f80 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:52.830487 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-fb02f5d5-038e-46bf-94d9-c73b97f75f80 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:52.895377 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-fb02f5d5-038e-46bf-94d9-c73b97f75f80 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:52.911269 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-fb02f5d5-038e-46bf-94d9-c73b97f75f80 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:52.914867 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-fb02f5d5-038e-46bf-94d9-c73b97f75f80 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:52.916941 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-fb02f5d5-038e-46bf-94d9-c73b97f75f80 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1286 microversion: 2.20 time: 0.100326 Jun 07 08:42:52.917959 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 285/559] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:42:52 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1286 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:42:52.934815 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-b05162e8-0704-46a9-a434-0fdb754641cd tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:52.941991 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-b05162e8-0704-46a9-a434-0fdb754641cd tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1755 microversion: 2.1 time: 0.181988 Jun 07 08:42:52.942553 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 275/560] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:52 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:53.935777 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-abe02867-be03-4e12-82f1-16235395b7e0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:53.936354 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-abe02867-be03-4e12-82f1-16235395b7e0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:53.938760 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:42:53.944771 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-abe02867-be03-4e12-82f1-16235395b7e0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:53.945318 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-abe02867-be03-4e12-82f1-16235395b7e0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:53.946196 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-abe02867-be03-4e12-82f1-16235395b7e0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:53.946682 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-abe02867-be03-4e12-82f1-16235395b7e0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:53.964000 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-bba98210-2da1-4fa6-982f-f778fa670024 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:53.965057 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-bba98210-2da1-4fa6-982f-f778fa670024 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:53.974738 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-bba98210-2da1-4fa6-982f-f778fa670024 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:53.975466 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-bba98210-2da1-4fa6-982f-f778fa670024 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:53.976708 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-bba98210-2da1-4fa6-982f-f778fa670024 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:53.977671 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-bba98210-2da1-4fa6-982f-f778fa670024 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:54.081051 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-abe02867-be03-4e12-82f1-16235395b7e0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:54.105617 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-abe02867-be03-4e12-82f1-16235395b7e0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:54.108246 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-abe02867-be03-4e12-82f1-16235395b7e0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:54.118044 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-abe02867-be03-4e12-82f1-16235395b7e0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1334 microversion: 2.20 time: 0.185755 Jun 07 08:42:54.129521 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 286/561] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:42:53 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1334 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:42:54.153585 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-bba98210-2da1-4fa6-982f-f778fa670024 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:54.162256 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-bba98210-2da1-4fa6-982f-f778fa670024 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1758 microversion: 2.1 time: 0.206152 Jun 07 08:42:54.162962 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 276/562] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:42:53 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1758 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:42:55.138355 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-d75c73c7-d0c5-4078-a5bf-03aaf1581501 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:55.139297 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-d75c73c7-d0c5-4078-a5bf-03aaf1581501 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:55.148787 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d75c73c7-d0c5-4078-a5bf-03aaf1581501 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:55.149353 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d75c73c7-d0c5-4078-a5bf-03aaf1581501 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:55.150434 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d75c73c7-d0c5-4078-a5bf-03aaf1581501 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:55.151234 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d75c73c7-d0c5-4078-a5bf-03aaf1581501 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:55.377925 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-d75c73c7-d0c5-4078-a5bf-03aaf1581501 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:55.387104 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-d75c73c7-d0c5-4078-a5bf-03aaf1581501 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:55.388659 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-d75c73c7-d0c5-4078-a5bf-03aaf1581501 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:55.389816 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-d75c73c7-d0c5-4078-a5bf-03aaf1581501 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1407 microversion: 2.20 time: 0.256494 Jun 07 08:42:55.390374 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 287/563] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:42:55 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1407 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:42:55.892214 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-d5341dc7-3c87-4661-b869-43f8a53dfc0f req-9cf16f0b-c611-43c5-9b9b-345fcd4a0a3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bff05aff-3c16-4b84-b927-eaa3917a4200", "tag": "ac5f8c52-180a-42f4-8102-9668d2229d61"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:42:55.906826 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-d5341dc7-3c87-4661-b869-43f8a53dfc0f req-9cf16f0b-c611-43c5-9b9b-345fcd4a0a3f service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:55.907294 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-d5341dc7-3c87-4661-b869-43f8a53dfc0f req-9cf16f0b-c611-43c5-9b9b-345fcd4a0a3f service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:55.919256 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-d5341dc7-3c87-4661-b869-43f8a53dfc0f req-9cf16f0b-c611-43c5-9b9b-345fcd4a0a3f service nova] Creating event network-changed:ac5f8c52-180a-42f4-8102-9668d2229d61 for instance bff05aff-3c16-4b84-b927-eaa3917a4200 on hv-cinder-74014 Jun 07 08:42:55.924380 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-d5341dc7-3c87-4661-b869-43f8a53dfc0f req-9cf16f0b-c611-43c5-9b9b-345fcd4a0a3f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037047 Jun 07 08:42:55.925129 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 277/564] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:42:56.410130 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-0b9ed8d2-9760-4c87-9b21-1f9c6a20ea09 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:56.410995 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-0b9ed8d2-9760-4c87-9b21-1f9c6a20ea09 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:56.420009 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0b9ed8d2-9760-4c87-9b21-1f9c6a20ea09 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:56.420799 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0b9ed8d2-9760-4c87-9b21-1f9c6a20ea09 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:56.421789 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0b9ed8d2-9760-4c87-9b21-1f9c6a20ea09 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:56.422331 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0b9ed8d2-9760-4c87-9b21-1f9c6a20ea09 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:56.635920 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-0b9ed8d2-9760-4c87-9b21-1f9c6a20ea09 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:56.644779 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-0b9ed8d2-9760-4c87-9b21-1f9c6a20ea09 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:56.647615 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-0b9ed8d2-9760-4c87-9b21-1f9c6a20ea09 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:56.648134 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-0b9ed8d2-9760-4c87-9b21-1f9c6a20ea09 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1407 microversion: 2.20 time: 0.242392 Jun 07 08:42:56.648695 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 288/565] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:42:56 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:42:57.668281 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-4c2598aa-b626-42a8-b27b-3f34e99094ef tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:57.668981 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-4c2598aa-b626-42a8-b27b-3f34e99094ef tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:57.675272 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4c2598aa-b626-42a8-b27b-3f34e99094ef tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:57.675904 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4c2598aa-b626-42a8-b27b-3f34e99094ef tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:57.676668 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4c2598aa-b626-42a8-b27b-3f34e99094ef tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:57.677157 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4c2598aa-b626-42a8-b27b-3f34e99094ef tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:57.826756 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-4c2598aa-b626-42a8-b27b-3f34e99094ef tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:57.835417 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-4c2598aa-b626-42a8-b27b-3f34e99094ef tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:57.836934 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-4c2598aa-b626-42a8-b27b-3f34e99094ef tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:57.838085 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-4c2598aa-b626-42a8-b27b-3f34e99094ef tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1407 microversion: 2.20 time: 0.174563 Jun 07 08:42:57.838652 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 278/566] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:42:57 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:42:58.859315 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-79f9c68d-1542-46d7-8d5e-7688c69a4543 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:42:58.859986 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-79f9c68d-1542-46d7-8d5e-7688c69a4543 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:42:58.867083 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-79f9c68d-1542-46d7-8d5e-7688c69a4543 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:58.867526 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-79f9c68d-1542-46d7-8d5e-7688c69a4543 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:58.868285 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-79f9c68d-1542-46d7-8d5e-7688c69a4543 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:42:58.868716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-79f9c68d-1542-46d7-8d5e-7688c69a4543 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:42:59.229811 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-79f9c68d-1542-46d7-8d5e-7688c69a4543 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:59.237697 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-79f9c68d-1542-46d7-8d5e-7688c69a4543 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:59.239342 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-79f9c68d-1542-46d7-8d5e-7688c69a4543 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:42:59.240437 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-79f9c68d-1542-46d7-8d5e-7688c69a4543 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1407 microversion: 2.20 time: 0.385009 Jun 07 08:42:59.241011 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 289/567] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:42:58 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1407 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:43:00.258995 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-c1ec0d3d-2a6e-44cf-aa99-0fdc03135f61 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:00.259559 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-c1ec0d3d-2a6e-44cf-aa99-0fdc03135f61 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:00.261539 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell0:SELECT=4 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:43:00.266866 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c1ec0d3d-2a6e-44cf-aa99-0fdc03135f61 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:00.267315 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c1ec0d3d-2a6e-44cf-aa99-0fdc03135f61 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:00.268082 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c1ec0d3d-2a6e-44cf-aa99-0fdc03135f61 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:00.268520 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c1ec0d3d-2a6e-44cf-aa99-0fdc03135f61 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:00.399210 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-c1ec0d3d-2a6e-44cf-aa99-0fdc03135f61 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:00.407493 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-c1ec0d3d-2a6e-44cf-aa99-0fdc03135f61 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:00.409112 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-c1ec0d3d-2a6e-44cf-aa99-0fdc03135f61 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:00.410316 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-c1ec0d3d-2a6e-44cf-aa99-0fdc03135f61 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1407 microversion: 2.20 time: 0.155866 Jun 07 08:43:00.410872 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 279/568] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:43:00 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:43:01.433815 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-37769754-9462-4c8c-96d2-6773ed0d6540 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:01.434490 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-37769754-9462-4c8c-96d2-6773ed0d6540 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:01.441427 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-37769754-9462-4c8c-96d2-6773ed0d6540 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:01.441881 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-37769754-9462-4c8c-96d2-6773ed0d6540 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:01.442656 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-37769754-9462-4c8c-96d2-6773ed0d6540 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:01.443091 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-37769754-9462-4c8c-96d2-6773ed0d6540 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:01.537948 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell0:SELECT=2 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:43:01.580382 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-37769754-9462-4c8c-96d2-6773ed0d6540 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:01.587662 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-37769754-9462-4c8c-96d2-6773ed0d6540 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:01.589143 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-37769754-9462-4c8c-96d2-6773ed0d6540 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:01.590257 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-37769754-9462-4c8c-96d2-6773ed0d6540 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1407 microversion: 2.20 time: 0.162020 Jun 07 08:43:01.590864 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 290/569] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:43:01 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:43:01.629964 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-986e9d6a-c7be-49b5-8c73-609bc13fe2af req-53da7cae-634e-4ae2-8371-08eb6e9c6845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bff05aff-3c16-4b84-b927-eaa3917a4200", "name": "network-vif-plugged", "status": "completed", "tag": "ac5f8c52-180a-42f4-8102-9668d2229d61"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:43:01.639884 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-986e9d6a-c7be-49b5-8c73-609bc13fe2af req-53da7cae-634e-4ae2-8371-08eb6e9c6845 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:01.640184 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-986e9d6a-c7be-49b5-8c73-609bc13fe2af req-53da7cae-634e-4ae2-8371-08eb6e9c6845 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:01.651490 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-986e9d6a-c7be-49b5-8c73-609bc13fe2af req-53da7cae-634e-4ae2-8371-08eb6e9c6845 service nova] Creating event network-vif-plugged:ac5f8c52-180a-42f4-8102-9668d2229d61 for instance bff05aff-3c16-4b84-b927-eaa3917a4200 on hv-cinder-74014 Jun 07 08:43:01.660882 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-986e9d6a-c7be-49b5-8c73-609bc13fe2af req-53da7cae-634e-4ae2-8371-08eb6e9c6845 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030674 Jun 07 08:43:01.660882 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 280/570] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:43:02.608457 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-1398b58e-9ba6-4fb7-9579-00f53d3e7b6d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:02.609051 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-1398b58e-9ba6-4fb7-9579-00f53d3e7b6d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:02.610851 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell0:SELECT=8 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:43:02.616832 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1398b58e-9ba6-4fb7-9579-00f53d3e7b6d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:02.621482 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1398b58e-9ba6-4fb7-9579-00f53d3e7b6d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:02.621482 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1398b58e-9ba6-4fb7-9579-00f53d3e7b6d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:02.621482 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1398b58e-9ba6-4fb7-9579-00f53d3e7b6d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:02.751483 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-1398b58e-9ba6-4fb7-9579-00f53d3e7b6d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:02.759808 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-1398b58e-9ba6-4fb7-9579-00f53d3e7b6d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:02.761323 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-1398b58e-9ba6-4fb7-9579-00f53d3e7b6d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:02.762418 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-1398b58e-9ba6-4fb7-9579-00f53d3e7b6d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1407 microversion: 2.20 time: 0.157989 Jun 07 08:43:02.762984 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 291/571] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:43:02 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:43:03.781552 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-921dc6e9-6d05-4307-bdab-d2bfa5beb4ad tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:03.782249 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-921dc6e9-6d05-4307-bdab-d2bfa5beb4ad tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:03.789291 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-921dc6e9-6d05-4307-bdab-d2bfa5beb4ad tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:03.789748 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-921dc6e9-6d05-4307-bdab-d2bfa5beb4ad tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:03.790512 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-921dc6e9-6d05-4307-bdab-d2bfa5beb4ad tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:03.791003 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-921dc6e9-6d05-4307-bdab-d2bfa5beb4ad tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:03.933726 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-921dc6e9-6d05-4307-bdab-d2bfa5beb4ad tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:03.942304 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-921dc6e9-6d05-4307-bdab-d2bfa5beb4ad tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:03.944440 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-921dc6e9-6d05-4307-bdab-d2bfa5beb4ad tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:03.945597 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-921dc6e9-6d05-4307-bdab-d2bfa5beb4ad tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1407 microversion: 2.20 time: 0.168683 Jun 07 08:43:03.946167 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 281/572] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:43:03 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:43:04.964587 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-36925471-ee5c-4393-8be0-02b8f9cd00e0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:04.965255 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-36925471-ee5c-4393-8be0-02b8f9cd00e0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:04.972508 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-36925471-ee5c-4393-8be0-02b8f9cd00e0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:04.972959 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-36925471-ee5c-4393-8be0-02b8f9cd00e0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:04.973962 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-36925471-ee5c-4393-8be0-02b8f9cd00e0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:04.974433 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-36925471-ee5c-4393-8be0-02b8f9cd00e0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:05.112229 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-36925471-ee5c-4393-8be0-02b8f9cd00e0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:05.120355 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-36925471-ee5c-4393-8be0-02b8f9cd00e0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:05.121891 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-36925471-ee5c-4393-8be0-02b8f9cd00e0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:05.123040 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-36925471-ee5c-4393-8be0-02b8f9cd00e0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1598 microversion: 2.20 time: 0.163439 Jun 07 08:43:05.123871 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 292/573] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:43:04 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1598 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:43:05.140819 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-8ba802f9-4dbb-4c14-9657-afb26591e066 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:05.141511 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-8ba802f9-4dbb-4c14-9657-afb26591e066 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:05.148490 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8ba802f9-4dbb-4c14-9657-afb26591e066 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:05.148936 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8ba802f9-4dbb-4c14-9657-afb26591e066 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:05.149719 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8ba802f9-4dbb-4c14-9657-afb26591e066 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:05.150150 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8ba802f9-4dbb-4c14-9657-afb26591e066 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:05.230311 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-8ba802f9-4dbb-4c14-9657-afb26591e066 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093236 Jun 07 08:43:05.230906 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 282/574] 10.222.0.17 () {60 vars in 1315 bytes} [Tue Jun 7 08:43:05 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 08:43:06.227417 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-9b931a00-8b05-4790-ab40-12983f853e7b req-087b4ee9-08bb-4dac-811e-ba2b14276c5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bff05aff-3c16-4b84-b927-eaa3917a4200", "tag": "ac5f8c52-180a-42f4-8102-9668d2229d61"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:43:06.236025 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-9b931a00-8b05-4790-ab40-12983f853e7b req-087b4ee9-08bb-4dac-811e-ba2b14276c5d service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:06.236599 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-9b931a00-8b05-4790-ab40-12983f853e7b req-087b4ee9-08bb-4dac-811e-ba2b14276c5d service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:06.247639 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-9b931a00-8b05-4790-ab40-12983f853e7b req-087b4ee9-08bb-4dac-811e-ba2b14276c5d service nova] Creating event network-changed:ac5f8c52-180a-42f4-8102-9668d2229d61 for instance bff05aff-3c16-4b84-b927-eaa3917a4200 on hv-cinder-74014 Jun 07 08:43:06.252732 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-9b931a00-8b05-4790-ab40-12983f853e7b req-087b4ee9-08bb-4dac-811e-ba2b14276c5d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029522 Jun 07 08:43:06.253397 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 293/575] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:43:08.289241 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-299f79af-a15b-4cf3-b168-ab97f989a5f0 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:08.290762 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-299f79af-a15b-4cf3-b168-ab97f989a5f0 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:08.296981 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-299f79af-a15b-4cf3-b168-ab97f989a5f0 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:08.297467 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-299f79af-a15b-4cf3-b168-ab97f989a5f0 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:08.298237 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-299f79af-a15b-4cf3-b168-ab97f989a5f0 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:08.298683 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-299f79af-a15b-4cf3-b168-ab97f989a5f0 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:08.328626 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-299f79af-a15b-4cf3-b168-ab97f989a5f0 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044400 Jun 07 08:43:08.329227 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 283/576] 10.222.0.17 () {58 vars in 1301 bytes} [Tue Jun 7 08:43:08 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 08:43:08.394444 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-11a90f46-d34c-4dd8-932b-581e89b489f5 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:08.395135 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-11a90f46-d34c-4dd8-932b-581e89b489f5 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:08.402217 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-11a90f46-d34c-4dd8-932b-581e89b489f5 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:08.402780 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-11a90f46-d34c-4dd8-932b-581e89b489f5 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:08.403635 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-11a90f46-d34c-4dd8-932b-581e89b489f5 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:08.404154 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-11a90f46-d34c-4dd8-932b-581e89b489f5 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:08.430030 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-11a90f46-d34c-4dd8-932b-581e89b489f5 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Going to try to terminate instance {{(pid=129725) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 08:43:08.673513 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-11a90f46-d34c-4dd8-932b-581e89b489f5 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 204 len: 0 microversion: 2.1 time: 0.283279 Jun 07 08:43:08.674103 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 294/577] 10.222.0.17 () {58 vars in 1238 bytes} [Tue Jun 7 08:43:08 2022] DELETE /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 08:43:08.682258 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-adea407d-3586-41ca-98cf-42eabe976d06 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:08.682869 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-adea407d-3586-41ca-98cf-42eabe976d06 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:08.688901 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-adea407d-3586-41ca-98cf-42eabe976d06 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:08.689442 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-adea407d-3586-41ca-98cf-42eabe976d06 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:08.690197 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-adea407d-3586-41ca-98cf-42eabe976d06 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:08.690628 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-adea407d-3586-41ca-98cf-42eabe976d06 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:08.827007 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-adea407d-3586-41ca-98cf-42eabe976d06 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:08.835454 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-adea407d-3586-41ca-98cf-42eabe976d06 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1671 microversion: 2.1 time: 0.156974 Jun 07 08:43:08.835941 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 284/578] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:08 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:43:09.852759 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-68220b98-fe20-4638-85ce-776821bd2f4f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:09.853474 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-68220b98-fe20-4638-85ce-776821bd2f4f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:09.859934 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-68220b98-fe20-4638-85ce-776821bd2f4f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:09.860377 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-68220b98-fe20-4638-85ce-776821bd2f4f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:09.861171 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-68220b98-fe20-4638-85ce-776821bd2f4f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:09.861600 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-68220b98-fe20-4638-85ce-776821bd2f4f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:09.864210 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:43:09.994363 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-68220b98-fe20-4638-85ce-776821bd2f4f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:10.002104 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-68220b98-fe20-4638-85ce-776821bd2f4f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1671 microversion: 2.1 time: 0.154180 Jun 07 08:43:10.002670 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 295/579] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:09 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:43:11.019501 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-c775365f-bc6b-48c9-a452-0968161de778 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:11.020133 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-c775365f-bc6b-48c9-a452-0968161de778 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:11.029129 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c775365f-bc6b-48c9-a452-0968161de778 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:11.029803 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c775365f-bc6b-48c9-a452-0968161de778 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:11.031315 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c775365f-bc6b-48c9-a452-0968161de778 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:11.031850 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c775365f-bc6b-48c9-a452-0968161de778 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:11.343315 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-c775365f-bc6b-48c9-a452-0968161de778 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:11.351849 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-c775365f-bc6b-48c9-a452-0968161de778 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1671 microversion: 2.1 time: 0.336247 Jun 07 08:43:11.352432 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 285/580] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:11 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1671 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:43:11.504181 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-a8fb2c52-97e3-4fd6-bd0c-573ca2202e29 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:11.504711 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-a8fb2c52-97e3-4fd6-bd0c-573ca2202e29 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:11.511908 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a8fb2c52-97e3-4fd6-bd0c-573ca2202e29 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:11.512355 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a8fb2c52-97e3-4fd6-bd0c-573ca2202e29 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:11.513150 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a8fb2c52-97e3-4fd6-bd0c-573ca2202e29 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:11.513585 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a8fb2c52-97e3-4fd6-bd0c-573ca2202e29 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:11.644386 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.objects.instance [None req-a8fb2c52-97e3-4fd6-bd0c-573ca2202e29 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lazy-loading 'services' on Instance uuid af1b519f-b5c9-4e6a-8413-8ce7ace3024c {{(pid=129725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:43:11.866072 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-a8fb2c52-97e3-4fd6-bd0c-573ca2202e29 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "DELETE /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c/os-volume_attachments/09650d5e-d7fe-442f-ac94-0774fac75b96" status: 202 len: 0 microversion: 2.1 time: 0.365445 Jun 07 08:43:11.866668 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 296/581] 10.222.0.17 () {58 vars in 1415 bytes} [Tue Jun 7 08:43:11 2022] DELETE /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c/os-volume_attachments/09650d5e-d7fe-442f-ac94-0774fac75b96 => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 08:43:11.875330 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-35303310-c4f6-4c9a-92bf-461cc0de78b1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:11.876651 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-35303310-c4f6-4c9a-92bf-461cc0de78b1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:11.883947 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-35303310-c4f6-4c9a-92bf-461cc0de78b1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:11.884851 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-35303310-c4f6-4c9a-92bf-461cc0de78b1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:11.885670 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-35303310-c4f6-4c9a-92bf-461cc0de78b1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:11.886116 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-35303310-c4f6-4c9a-92bf-461cc0de78b1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:11.918605 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-35303310-c4f6-4c9a-92bf-461cc0de78b1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047285 Jun 07 08:43:11.919346 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 286/582] 10.222.0.17 () {58 vars in 1301 bytes} [Tue Jun 7 08:43:11 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:43:12.077797 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-8eab1cf9-7c67-4d27-ba74-d242ccc942c8 req-89719bd1-2a5e-419f-838b-f6bf074f88f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7", "name": "network-vif-deleted", "tag": "cb22b910-c497-4ee0-831c-3c7b0d2ea236"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:43:12.087121 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-8eab1cf9-7c67-4d27-ba74-d242ccc942c8 req-89719bd1-2a5e-419f-838b-f6bf074f88f8 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:12.087560 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-8eab1cf9-7c67-4d27-ba74-d242ccc942c8 req-89719bd1-2a5e-419f-838b-f6bf074f88f8 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:12.098898 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-8eab1cf9-7c67-4d27-ba74-d242ccc942c8 req-89719bd1-2a5e-419f-838b-f6bf074f88f8 service nova] Creating event network-vif-deleted:cb22b910-c497-4ee0-831c-3c7b0d2ea236 for instance 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 on hv-cinder-74014 Jun 07 08:43:12.104733 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-8eab1cf9-7c67-4d27-ba74-d242ccc942c8 req-89719bd1-2a5e-419f-838b-f6bf074f88f8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031182 Jun 07 08:43:12.108529 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 297/583] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:43:12.369446 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-2e38bf25-166e-4e20-aa19-8c1298262d73 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:12.370075 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-2e38bf25-166e-4e20-aa19-8c1298262d73 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:12.372364 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:43:12.377803 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2e38bf25-166e-4e20-aa19-8c1298262d73 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:12.378316 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2e38bf25-166e-4e20-aa19-8c1298262d73 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:12.379093 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2e38bf25-166e-4e20-aa19-8c1298262d73 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:12.379523 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2e38bf25-166e-4e20-aa19-8c1298262d73 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:12.448586 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-2e38bf25-166e-4e20-aa19-8c1298262d73 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:12.457282 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-2e38bf25-166e-4e20-aa19-8c1298262d73 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1604 microversion: 2.1 time: 0.091770 Jun 07 08:43:12.457874 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 287/584] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:12 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1604 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:43:12.933299 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-ad05a5d4-3b3f-4bf9-b1b3-6b8eed9005e5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:12.934313 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-ad05a5d4-3b3f-4bf9-b1b3-6b8eed9005e5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:12.940645 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ad05a5d4-3b3f-4bf9-b1b3-6b8eed9005e5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:12.941213 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ad05a5d4-3b3f-4bf9-b1b3-6b8eed9005e5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:12.942149 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ad05a5d4-3b3f-4bf9-b1b3-6b8eed9005e5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:12.942619 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ad05a5d4-3b3f-4bf9-b1b3-6b8eed9005e5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:12.976902 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-ad05a5d4-3b3f-4bf9-b1b3-6b8eed9005e5 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049445 Jun 07 08:43:12.981731 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 298/585] 10.222.0.17 () {58 vars in 1301 bytes} [Tue Jun 7 08:43:12 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:43:13.477583 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-7b73e000-092a-4999-b522-48d92d2a09e3 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:13.477583 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-7b73e000-092a-4999-b522-48d92d2a09e3 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:13.483543 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7b73e000-092a-4999-b522-48d92d2a09e3 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:13.483998 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7b73e000-092a-4999-b522-48d92d2a09e3 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:13.484784 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7b73e000-092a-4999-b522-48d92d2a09e3 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:13.485254 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7b73e000-092a-4999-b522-48d92d2a09e3 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:13.518495 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7b73e000-092a-4999-b522-48d92d2a09e3 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:13.518950 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7b73e000-092a-4999-b522-48d92d2a09e3 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:13.519412 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.objects.instance [None req-7b73e000-092a-4999-b522-48d92d2a09e3 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lazy-loading 'fault' on Instance uuid 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 {{(pid=129726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:43:13.563619 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-7b73e000-092a-4999-b522-48d92d2a09e3 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:13.572366 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-7b73e000-092a-4999-b522-48d92d2a09e3 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 200 len: 1326 microversion: 2.1 time: 0.101228 Jun 07 08:43:13.572974 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 288/586] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:13 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 1326 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:43:13.989944 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-ec23921f-e2ab-4b9a-8258-fb1ce97f297a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:13.991567 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-ec23921f-e2ab-4b9a-8258-fb1ce97f297a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:13.998582 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ec23921f-e2ab-4b9a-8258-fb1ce97f297a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:13.999030 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ec23921f-e2ab-4b9a-8258-fb1ce97f297a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:13.999815 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ec23921f-e2ab-4b9a-8258-fb1ce97f297a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:14.000248 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ec23921f-e2ab-4b9a-8258-fb1ce97f297a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:14.030091 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-ec23921f-e2ab-4b9a-8258-fb1ce97f297a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044433 Jun 07 08:43:14.030935 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 299/587] 10.222.0.17 () {58 vars in 1301 bytes} [Tue Jun 7 08:43:13 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 08:43:14.110593 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-4d2a38b1-58de-4786-b58e-cf4c870a5a95 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:14.111083 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-4d2a38b1-58de-4786-b58e-cf4c870a5a95 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:14.117952 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4d2a38b1-58de-4786-b58e-cf4c870a5a95 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:14.118425 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4d2a38b1-58de-4786-b58e-cf4c870a5a95 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:14.119207 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4d2a38b1-58de-4786-b58e-cf4c870a5a95 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:14.119589 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4d2a38b1-58de-4786-b58e-cf4c870a5a95 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:14.144900 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-4d2a38b1-58de-4786-b58e-cf4c870a5a95 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Going to try to terminate instance {{(pid=129726) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 08:43:14.427887 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-4d2a38b1-58de-4786-b58e-cf4c870a5a95 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "DELETE /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 204 len: 0 microversion: 2.1 time: 0.320772 Jun 07 08:43:14.430952 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 289/588] 10.222.0.17 () {58 vars in 1238 bytes} [Tue Jun 7 08:43:14 2022] DELETE /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 08:43:14.437516 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-812665e5-493f-4353-883b-a2de51998d4c tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:14.438123 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-812665e5-493f-4353-883b-a2de51998d4c tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:14.444806 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-812665e5-493f-4353-883b-a2de51998d4c tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:14.445280 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-812665e5-493f-4353-883b-a2de51998d4c tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:14.446037 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-812665e5-493f-4353-883b-a2de51998d4c tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:14.446462 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-812665e5-493f-4353-883b-a2de51998d4c tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:14.594247 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-7997b8fa-1d30-4d25-9ae9-ccbdc4436ee0 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:14.594948 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-7997b8fa-1d30-4d25-9ae9-ccbdc4436ee0 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:14.601615 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7997b8fa-1d30-4d25-9ae9-ccbdc4436ee0 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:14.602066 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7997b8fa-1d30-4d25-9ae9-ccbdc4436ee0 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:14.602824 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7997b8fa-1d30-4d25-9ae9-ccbdc4436ee0 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:14.603255 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7997b8fa-1d30-4d25-9ae9-ccbdc4436ee0 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:14.607354 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:43:14.618675 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.wsgi [None req-7997b8fa-1d30-4d25-9ae9-ccbdc4436ee0 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] HTTP exception thrown: Instance 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 could not be found. Jun 07 08:43:14.620309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-7997b8fa-1d30-4d25-9ae9-ccbdc4436ee0 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Request method failure captured: Jun 07 08:43:14.620309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: request: GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 HTTP/1.1 Jun 07 08:43:14.620309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept: application/json Jun 07 08:43:14.620309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept-Encoding: identity Jun 07 08:43:14.620309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Connection: close Jun 07 08:43:14.620309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Length: 0 Jun 07 08:43:14.620309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Type: application/json Jun 07 08:43:14.620309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Host: 10.222.0.17 Jun 07 08:43:14.620309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Openstack-System-Scope: None Jun 07 08:43:14.620309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: User-Agent: python-urllib3/1.26.9 Jun 07 08:43:14.620309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Auth-Token: gAAAAABinw6-7el6TUaqlSfN6ox6uip34y8etluDfGlaTvausajvfgvls2A0jjAYCLH5pC2itfXzYgt0jZueYHUX00suhcuAIAy6nVtlE5ArpM_LsQjOZCWM2paJeDTt2dg8brNA5YPORh5W6IjC4hRH--5OrwOOBsIAsxbPHTDmHpCTKZg9-Cg Jun 07 08:43:14.620309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Id: None Jun 07 08:43:14.620309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Name: None Jun 07 08:43:14.620309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Identity-Status: Confirmed Jun 07 08:43:14.620309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Is-Admin-Project: True Jun 07 08:43:14.620309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Id: default Jun 07 08:43:14.620309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Name: Default Jun 07 08:43:14.620309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Id: 5daf862eb4de4ea992b35692f003a25e Jun 07 08:43:14.620309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Name: tempest-AttachVolumeTestJSON-888820175 Jun 07 08:43:14.620309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Role: reader,member Jun 07 08:43:14.620309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Roles: reader,member Jun 07 08:43:14.624522 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5daf862eb4de4ea992b35692f003a25e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5daf862eb4de4ea992b35692f003a25e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5daf862eb4de4ea992b35692f003a25e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5daf862eb4de4ea992b35692f003a25e"}]}] Jun 07 08:43:14.624522 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant: tempest-AttachVolumeTestJSON-888820175 Jun 07 08:43:14.624522 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Id: 5daf862eb4de4ea992b35692f003a25e Jun 07 08:43:14.624522 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Name: tempest-AttachVolumeTestJSON-888820175 Jun 07 08:43:14.624522 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User: tempest-AttachVolumeTestJSON-888820175-project Jun 07 08:43:14.624522 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Id: default Jun 07 08:43:14.624522 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Name: Default Jun 07 08:43:14.624522 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Id: 4e5893f0909446ff82b5a72584ecae37 Jun 07 08:43:14.624522 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Name: tempest-AttachVolumeTestJSON-888820175-project Jun 07 08:43:14.624522 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: method: > Jun 07 08:43:14.624522 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: exception: Instance 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 could not be found. Jun 07 08:43:14.624522 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: action_args: {'id': '9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7'} Jun 07 08:43:14.625457 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:43:14.625457 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:43:14.625457 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:43:14.625457 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:43:14.625457 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:43:14.625457 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:43:14.625457 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:43:14.625457 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:43:14.625457 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:43:14.625457 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:43:14.625457 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 could not be found. Jun 07 08:43:14.625457 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:43:14.625457 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:43:14.625457 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:43:14.625457 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:43:14.625457 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:43:14.625457 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:43:14.625457 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:43:14.625457 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:43:14.625457 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:43:14.626815 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:43:14.626815 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 08:43:14.626815 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 08:43:14.626815 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:43:14.626815 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:43:14.626815 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:43:14.626815 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:43:14.626815 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 could not be found. Jun 07 08:43:14.626815 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:43:14.626815 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:43:14.626815 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:43:14.626815 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:43:14.626815 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:43:14.626815 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:43:14.626815 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:43:14.626815 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:43:14.626815 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 could not be found. Jun 07 08:43:14.626815 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:43:14.628069 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-7997b8fa-1d30-4d25-9ae9-ccbdc4436ee0 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Returning 404 to user: Instance 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 could not be found. {{(pid=129726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:43:14.628069 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-7997b8fa-1d30-4d25-9ae9-ccbdc4436ee0 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 404 len: 111 microversion: 2.1 time: 0.031708 Jun 07 08:43:14.628069 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 290/589] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:14 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 08:43:14.632426 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-d2841698-a055-4d21-8ebf-b818eae6f47e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '.version_select at 0x7f7fecb31d30>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:14.638881 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-812665e5-493f-4353-883b-a2de51998d4c tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:14.646826 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-812665e5-493f-4353-883b-a2de51998d4c tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1689 microversion: 2.1 time: 0.213451 Jun 07 08:43:14.647976 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 300/590] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:14 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1689 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:43:14.708284 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-d2841698-a055-4d21-8ebf-b818eae6f47e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-283053816" status: 202 len: 0 microversion: 2.1 time: 0.080025 Jun 07 08:43:14.708806 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 291/591] 10.222.0.17 () {58 vars in 1217 bytes} [Tue Jun 7 08:43:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-283053816 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 08:43:15.472424 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-18c744ed-dd8c-4793-ab7d-a57f7660b083 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Action: 'create', calling method: .version_select at 0x7f7fedc24af0>, body: {"keypair": {"name": "tempest-keypair-1010843116", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsqkLDJlFqck/NytPsGUyX7vSD/GOD4IyWJ3SJzSCGljmrn2u/CpCdRzI8Pii2WHZAm/YV0w1/SqkAbUolF8q6K5aVM7Bh2PwOaB+1lYzSWdWjHsnMv1EX2+D1OWF8Xgg=="}} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:43:15.491952 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.quota [None req-18c744ed-dd8c-4793-ab7d-a57f7660b083 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Getting quotas for project 5daf862eb4de4ea992b35692f003a25e. Resources: {'key_pairs'} {{(pid=129725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 08:43:15.495816 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.quota [None req-18c744ed-dd8c-4793-ab7d-a57f7660b083 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Getting quotas for user 4e5893f0909446ff82b5a72584ecae37 and project 5daf862eb4de4ea992b35692f003a25e. Resources: {'key_pairs'} {{(pid=129725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 08:43:15.577410 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-18c744ed-dd8c-4793-ab7d-a57f7660b083 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.109259 Jun 07 08:43:15.578022 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 301/592] 10.222.0.17 () {60 vars in 1158 bytes} [Tue Jun 7 08:43:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:43:15.666433 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-89e77743-487b-440b-80f2-d7a1240900b3 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:15.667257 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-89e77743-487b-440b-80f2-d7a1240900b3 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:15.674658 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-89e77743-487b-440b-80f2-d7a1240900b3 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:15.675113 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-89e77743-487b-440b-80f2-d7a1240900b3 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:15.675887 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-89e77743-487b-440b-80f2-d7a1240900b3 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:15.676324 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-89e77743-487b-440b-80f2-d7a1240900b3 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:15.846278 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-89e77743-487b-440b-80f2-d7a1240900b3 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:15.854644 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-89e77743-487b-440b-80f2-d7a1240900b3 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1689 microversion: 2.1 time: 0.192939 Jun 07 08:43:15.855046 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 292/593] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:15 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1689 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:43:16.873681 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-c3a6cda5-65e1-47a4-9e16-67db5904bf23 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:16.874324 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-c3a6cda5-65e1-47a4-9e16-67db5904bf23 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:16.881017 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c3a6cda5-65e1-47a4-9e16-67db5904bf23 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:16.881427 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c3a6cda5-65e1-47a4-9e16-67db5904bf23 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:16.882721 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c3a6cda5-65e1-47a4-9e16-67db5904bf23 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:16.883146 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c3a6cda5-65e1-47a4-9e16-67db5904bf23 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:17.039682 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-c3a6cda5-65e1-47a4-9e16-67db5904bf23 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:17.050499 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-c3a6cda5-65e1-47a4-9e16-67db5904bf23 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1689 microversion: 2.1 time: 0.181480 Jun 07 08:43:17.051214 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 302/594] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:16 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1689 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:43:17.685624 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-0c19b800-8a2b-4ccd-88dc-7d65028d546f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1037196745", "imageRef": "c04b0a92-7675-47c3-bcc2-8a2a59b997c3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c643e61b-55cc-4612-8364-89139fdafa24"}], "security_groups": [{"name": "tempest-securitygroup--42856807"}], "key_name": "tempest-keypair-1010843116", "user_data": "}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:43:17.813993 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.network.neutron [None req-0c19b800-8a2b-4ccd-88dc-7d65028d546f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] validate_networks() for [('c643e61b-55cc-4612-8364-89139fdafa24', None, None, None, None, None)] {{(pid=129726) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 08:43:18.070069 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-588af89a-3825-4168-8c8e-71d764dec97d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:18.070903 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-588af89a-3825-4168-8c8e-71d764dec97d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:18.077907 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-588af89a-3825-4168-8c8e-71d764dec97d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:18.078584 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-588af89a-3825-4168-8c8e-71d764dec97d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:18.079368 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-588af89a-3825-4168-8c8e-71d764dec97d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:18.079794 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-588af89a-3825-4168-8c8e-71d764dec97d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:18.229257 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-0c19b800-8a2b-4ccd-88dc-7d65028d546f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Flavor limits 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 08:43:18.229686 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-0c19b800-8a2b-4ccd-88dc-7d65028d546f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Image limits 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 08:43:18.230198 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-0c19b800-8a2b-4ccd-88dc-7d65028d546f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Flavor pref 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 08:43:18.230613 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-0c19b800-8a2b-4ccd-88dc-7d65028d546f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Image pref 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 08:43:18.231064 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-0c19b800-8a2b-4ccd-88dc-7d65028d546f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 08:43:18.246381 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0c19b800-8a2b-4ccd-88dc-7d65028d546f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:18.246836 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0c19b800-8a2b-4ccd-88dc-7d65028d546f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:18.247671 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0c19b800-8a2b-4ccd-88dc-7d65028d546f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:18.248136 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0c19b800-8a2b-4ccd-88dc-7d65028d546f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:18.272964 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-0c19b800-8a2b-4ccd-88dc-7d65028d546f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Getting quotas for project 5daf862eb4de4ea992b35692f003a25e. Resources: {'ram', 'cores', 'instances'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 08:43:18.277434 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-0c19b800-8a2b-4ccd-88dc-7d65028d546f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Getting quotas for user 4e5893f0909446ff82b5a72584ecae37 and project 5daf862eb4de4ea992b35692f003a25e. Resources: {'ram', 'cores', 'instances'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 08:43:18.292737 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-0c19b800-8a2b-4ccd-88dc-7d65028d546f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Going to run 1 instances... {{(pid=129726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 08:43:18.295138 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-0c19b800-8a2b-4ccd-88dc-7d65028d546f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c04b0a92-7675-47c3-bcc2-8a2a59b997c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 08:43:18.331501 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-588af89a-3825-4168-8c8e-71d764dec97d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:18.339803 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-588af89a-3825-4168-8c8e-71d764dec97d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1689 microversion: 2.1 time: 0.274225 Jun 07 08:43:18.340374 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 303/595] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:18 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1689 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:43:18.503995 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-0c19b800-8a2b-4ccd-88dc-7d65028d546f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.822536 Jun 07 08:43:18.504829 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 293/596] 10.222.0.17 () {60 vars in 1146 bytes} [Tue Jun 7 08:43:17 2022] POST /compute/v2.1/servers => generated 400 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 08:43:18.516202 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-4f4fd1b1-fc33-4426-8ade-c659f3b23509 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:18.517200 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-4f4fd1b1-fc33-4426-8ade-c659f3b23509 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:18.620317 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-4f4fd1b1-fc33-4426-8ade-c659f3b23509 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:18.629619 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-4f4fd1b1-fc33-4426-8ade-c659f3b23509 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971" status: 200 len: 1238 microversion: 2.1 time: 0.117526 Jun 07 08:43:18.630524 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 304/597] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:18 2022] GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971 => generated 1238 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:43:19.165058 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-06cb18ba-9dbf-473a-a2a0-2833c66ea22a req-2759be5f-3603-45f9-b70c-bd121bc5d55f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af1b519f-b5c9-4e6a-8413-8ce7ace3024c", "name": "network-vif-deleted", "tag": "888115bf-712f-4cb1-b6a5-86649fc08594"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:43:19.180138 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-06cb18ba-9dbf-473a-a2a0-2833c66ea22a req-2759be5f-3603-45f9-b70c-bd121bc5d55f service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:19.180645 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-06cb18ba-9dbf-473a-a2a0-2833c66ea22a req-2759be5f-3603-45f9-b70c-bd121bc5d55f service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:19.196275 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-06cb18ba-9dbf-473a-a2a0-2833c66ea22a req-2759be5f-3603-45f9-b70c-bd121bc5d55f service nova] Creating event network-vif-deleted:888115bf-712f-4cb1-b6a5-86649fc08594 for instance af1b519f-b5c9-4e6a-8413-8ce7ace3024c on hv-cinder-74014 Jun 07 08:43:19.200898 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-06cb18ba-9dbf-473a-a2a0-2833c66ea22a req-2759be5f-3603-45f9-b70c-bd121bc5d55f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039622 Jun 07 08:43:19.202294 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 294/598] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:43:19.434661 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-122e79be-cdc5-45d9-bc84-87aae2597dcf tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:19.436257 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-122e79be-cdc5-45d9-bc84-87aae2597dcf tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:19.443960 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-122e79be-cdc5-45d9-bc84-87aae2597dcf tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:19.444469 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-122e79be-cdc5-45d9-bc84-87aae2597dcf tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:19.445359 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-122e79be-cdc5-45d9-bc84-87aae2597dcf tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:19.445794 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-122e79be-cdc5-45d9-bc84-87aae2597dcf tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:19.522918 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-122e79be-cdc5-45d9-bc84-87aae2597dcf tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:19.525375 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-122e79be-cdc5-45d9-bc84-87aae2597dcf tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 200 len: 1331 microversion: 2.1 time: 0.172716 Jun 07 08:43:19.525736 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 305/599] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:19 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 1331 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:43:19.647668 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-399fe601-cd2a-4d26-9628-e949fc863d71 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:19.657214 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-399fe601-cd2a-4d26-9628-e949fc863d71 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:19.657214 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-399fe601-cd2a-4d26-9628-e949fc863d71 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:19.657214 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-399fe601-cd2a-4d26-9628-e949fc863d71 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:19.657214 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-399fe601-cd2a-4d26-9628-e949fc863d71 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:19.657703 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-399fe601-cd2a-4d26-9628-e949fc863d71 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:19.724025 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-399fe601-cd2a-4d26-9628-e949fc863d71 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:19.735916 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-399fe601-cd2a-4d26-9628-e949fc863d71 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971" status: 200 len: 1242 microversion: 2.1 time: 0.092319 Jun 07 08:43:19.749159 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 295/600] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:19 2022] GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971 => generated 1242 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:43:20.544580 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-9230886c-80ce-43b2-aab6-7900f57eba26 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:20.545303 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-9230886c-80ce-43b2-aab6-7900f57eba26 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: af1b519f-b5c9-4e6a-8413-8ce7ace3024c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:20.553102 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9230886c-80ce-43b2-aab6-7900f57eba26 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:20.553746 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9230886c-80ce-43b2-aab6-7900f57eba26 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:20.554689 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9230886c-80ce-43b2-aab6-7900f57eba26 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:20.555133 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9230886c-80ce-43b2-aab6-7900f57eba26 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:20.571142 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.wsgi [None req-9230886c-80ce-43b2-aab6-7900f57eba26 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] HTTP exception thrown: Instance af1b519f-b5c9-4e6a-8413-8ce7ace3024c could not be found. Jun 07 08:43:20.573087 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-9230886c-80ce-43b2-aab6-7900f57eba26 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Request method failure captured: Jun 07 08:43:20.573087 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: request: GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c HTTP/1.1 Jun 07 08:43:20.573087 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept: application/json Jun 07 08:43:20.573087 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept-Encoding: identity Jun 07 08:43:20.573087 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Connection: close Jun 07 08:43:20.573087 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Length: 0 Jun 07 08:43:20.573087 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Type: application/json Jun 07 08:43:20.573087 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Host: 10.222.0.17 Jun 07 08:43:20.573087 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Openstack-System-Scope: None Jun 07 08:43:20.573087 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: User-Agent: python-urllib3/1.26.9 Jun 07 08:43:20.573087 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Auth-Token: gAAAAABinw56gFqEMZtH-I0OxhDG-zG6My9swmCke2xrKyH-Hi3vn7-umR3bhinsgBM-VBrrIJFaQdJKLbe8_s6_ve07jIkgyhtY0t3tA8s4W3pn-RsLOgTMCSA2ud98s6n92bGn7O40KljBfpr0883mO-X5ZsF73uXRGoWztv8PfwpUy-0skp0 Jun 07 08:43:20.573087 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Id: None Jun 07 08:43:20.573087 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Name: None Jun 07 08:43:20.573087 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Identity-Status: Confirmed Jun 07 08:43:20.573087 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Is-Admin-Project: True Jun 07 08:43:20.573087 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Id: default Jun 07 08:43:20.573087 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Name: Default Jun 07 08:43:20.573087 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Id: 10b79d91933b4f7f9f32d66138e18373 Jun 07 08:43:20.573087 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-311181591 Jun 07 08:43:20.573087 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Role: reader,member Jun 07 08:43:20.573087 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Roles: reader,member Jun 07 08:43:20.574630 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/10b79d91933b4f7f9f32d66138e18373"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/10b79d91933b4f7f9f32d66138e18373"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_10b79d91933b4f7f9f32d66138e18373", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/10b79d91933b4f7f9f32d66138e18373"}]}] Jun 07 08:43:20.574630 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant: tempest-ServerRescueNegativeTestJSON-311181591 Jun 07 08:43:20.574630 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Id: 10b79d91933b4f7f9f32d66138e18373 Jun 07 08:43:20.574630 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-311181591 Jun 07 08:43:20.574630 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User: tempest-ServerRescueNegativeTestJSON-311181591-project Jun 07 08:43:20.574630 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Id: default Jun 07 08:43:20.574630 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Name: Default Jun 07 08:43:20.574630 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Id: 055ec8a54bdf400fac0a46b0e5497f1b Jun 07 08:43:20.574630 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Name: tempest-ServerRescueNegativeTestJSON-311181591-project Jun 07 08:43:20.574630 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: method: > Jun 07 08:43:20.574630 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: exception: Instance af1b519f-b5c9-4e6a-8413-8ce7ace3024c could not be found. Jun 07 08:43:20.574630 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: action_args: {'id': 'af1b519f-b5c9-4e6a-8413-8ce7ace3024c'} Jun 07 08:43:20.575493 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:43:20.575493 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:43:20.575493 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:43:20.575493 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:43:20.575493 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:43:20.575493 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:43:20.575493 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:43:20.575493 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:43:20.575493 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:43:20.575493 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:43:20.575493 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af1b519f-b5c9-4e6a-8413-8ce7ace3024c could not be found. Jun 07 08:43:20.575493 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:43:20.575493 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:43:20.575493 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:43:20.575493 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:43:20.575493 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:43:20.575493 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:43:20.575493 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:43:20.575493 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:43:20.575493 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:43:20.577059 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:43:20.577059 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 08:43:20.577059 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 08:43:20.577059 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:43:20.577059 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:43:20.577059 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:43:20.577059 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:43:20.577059 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af1b519f-b5c9-4e6a-8413-8ce7ace3024c could not be found. Jun 07 08:43:20.577059 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:43:20.577059 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:43:20.577059 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:43:20.577059 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:43:20.577059 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:43:20.577059 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:43:20.577059 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:43:20.577059 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:43:20.577059 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af1b519f-b5c9-4e6a-8413-8ce7ace3024c could not be found. Jun 07 08:43:20.577059 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:43:20.578321 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-9230886c-80ce-43b2-aab6-7900f57eba26 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Returning 404 to user: Instance af1b519f-b5c9-4e6a-8413-8ce7ace3024c could not be found. {{(pid=129725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:43:20.578321 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-9230886c-80ce-43b2-aab6-7900f57eba26 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c" status: 404 len: 111 microversion: 2.1 time: 0.034936 Jun 07 08:43:20.578321 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 306/601] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:20 2022] GET /compute/v2.1/servers/af1b519f-b5c9-4e6a-8413-8ce7ace3024c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:43:20.586420 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-b36949d4-5389-4d5c-8645-a15bc77b3525 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '.version_select at 0x7f7fecae5ee0>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:20.685415 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-b36949d4-5389-4d5c-8645-a15bc77b3525 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1831763891" status: 202 len: 0 microversion: 2.1 time: 0.104746 Jun 07 08:43:20.686017 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 296/602] 10.222.0.17 () {58 vars in 1220 bytes} [Tue Jun 7 08:43:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1831763891 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 08:43:20.758416 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-633b3db1-d99a-4f8e-818e-d0f82a55ec2c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:20.759353 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-633b3db1-d99a-4f8e-818e-d0f82a55ec2c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:20.767814 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-633b3db1-d99a-4f8e-818e-d0f82a55ec2c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:20.772938 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-633b3db1-d99a-4f8e-818e-d0f82a55ec2c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:20.772938 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-633b3db1-d99a-4f8e-818e-d0f82a55ec2c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:20.772938 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-633b3db1-d99a-4f8e-818e-d0f82a55ec2c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:20.856854 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-633b3db1-d99a-4f8e-818e-d0f82a55ec2c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:20.864977 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-633b3db1-d99a-4f8e-818e-d0f82a55ec2c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971" status: 200 len: 1290 microversion: 2.1 time: 0.114495 Jun 07 08:43:20.865691 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 307/603] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:20 2022] GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971 => generated 1290 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:43:21.883920 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-5cfc66cc-18ca-4fd7-b0dd-f242fc9f483f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:21.885099 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-5cfc66cc-18ca-4fd7-b0dd-f242fc9f483f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:21.906252 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5cfc66cc-18ca-4fd7-b0dd-f242fc9f483f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:21.906870 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5cfc66cc-18ca-4fd7-b0dd-f242fc9f483f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:21.907739 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5cfc66cc-18ca-4fd7-b0dd-f242fc9f483f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:21.908441 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5cfc66cc-18ca-4fd7-b0dd-f242fc9f483f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:22.055122 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-5cfc66cc-18ca-4fd7-b0dd-f242fc9f483f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:22.062898 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-5cfc66cc-18ca-4fd7-b0dd-f242fc9f483f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971" status: 200 len: 1362 microversion: 2.1 time: 0.184373 Jun 07 08:43:22.063898 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 297/604] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:21 2022] GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:43:23.046107 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-91dd3476-0c22-4649-9df7-b3bd57f1dd8f req-41f316f9-ae32-4398-8a7e-0233a657d2fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7de79795-1332-477d-a70a-f1e87b662971", "tag": "096b6e40-1995-4715-a8ed-f4a9214a3135"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:43:23.055449 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-91dd3476-0c22-4649-9df7-b3bd57f1dd8f req-41f316f9-ae32-4398-8a7e-0233a657d2fd service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:23.055901 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-91dd3476-0c22-4649-9df7-b3bd57f1dd8f req-41f316f9-ae32-4398-8a7e-0233a657d2fd service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:23.068211 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-91dd3476-0c22-4649-9df7-b3bd57f1dd8f req-41f316f9-ae32-4398-8a7e-0233a657d2fd service nova] Creating event network-changed:096b6e40-1995-4715-a8ed-f4a9214a3135 for instance 7de79795-1332-477d-a70a-f1e87b662971 on hv-cinder-74014 Jun 07 08:43:23.073880 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-91dd3476-0c22-4649-9df7-b3bd57f1dd8f req-41f316f9-ae32-4398-8a7e-0233a657d2fd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032965 Jun 07 08:43:23.075013 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 308/605] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:43:23.079789 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-a534592c-933d-468a-bf13-fa4ea2662a04 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:23.080461 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-a534592c-933d-468a-bf13-fa4ea2662a04 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:23.087712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a534592c-933d-468a-bf13-fa4ea2662a04 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:23.088461 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a534592c-933d-468a-bf13-fa4ea2662a04 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:23.089294 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a534592c-933d-468a-bf13-fa4ea2662a04 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:23.089620 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a534592c-933d-468a-bf13-fa4ea2662a04 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:23.453679 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-a534592c-933d-468a-bf13-fa4ea2662a04 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:23.461596 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-a534592c-933d-468a-bf13-fa4ea2662a04 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971" status: 200 len: 1362 microversion: 2.1 time: 0.385746 Jun 07 08:43:23.462177 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 298/606] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:23 2022] GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971 => generated 1362 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:43:24.182311 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-bf89e96c-180f-43bd-852d-cdec2b2a29ec tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:24.182902 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-bf89e96c-180f-43bd-852d-cdec2b2a29ec tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:24.189171 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-bf89e96c-180f-43bd-852d-cdec2b2a29ec tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:24.189619 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-bf89e96c-180f-43bd-852d-cdec2b2a29ec tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:24.190391 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-bf89e96c-180f-43bd-852d-cdec2b2a29ec tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:24.190898 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-bf89e96c-180f-43bd-852d-cdec2b2a29ec tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:24.216636 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-bf89e96c-180f-43bd-852d-cdec2b2a29ec tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Going to try to terminate instance {{(pid=129725) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 08:43:24.478547 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-e81b2d14-68ab-4005-a17d-c9f8b46a8615 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:24.479202 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-e81b2d14-68ab-4005-a17d-c9f8b46a8615 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:24.483977 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-bf89e96c-180f-43bd-852d-cdec2b2a29ec tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 204 len: 0 microversion: 2.1 time: 0.306047 Jun 07 08:43:24.484613 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 309/607] 10.222.0.17 () {58 vars in 1238 bytes} [Tue Jun 7 08:43:24 2022] DELETE /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 08:43:24.485320 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e81b2d14-68ab-4005-a17d-c9f8b46a8615 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:24.485779 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e81b2d14-68ab-4005-a17d-c9f8b46a8615 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:24.486546 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e81b2d14-68ab-4005-a17d-c9f8b46a8615 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:24.486986 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e81b2d14-68ab-4005-a17d-c9f8b46a8615 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:24.492625 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-fdf62bba-efbb-4863-89e8-d15f572796e2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:24.493380 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-fdf62bba-efbb-4863-89e8-d15f572796e2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:24.499116 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-fdf62bba-efbb-4863-89e8-d15f572796e2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:24.499563 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-fdf62bba-efbb-4863-89e8-d15f572796e2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:24.500315 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-fdf62bba-efbb-4863-89e8-d15f572796e2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:24.500745 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-fdf62bba-efbb-4863-89e8-d15f572796e2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:24.616278 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-e81b2d14-68ab-4005-a17d-c9f8b46a8615 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:24.623633 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-e81b2d14-68ab-4005-a17d-c9f8b46a8615 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971" status: 200 len: 1362 microversion: 2.1 time: 0.149096 Jun 07 08:43:24.624204 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 299/608] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:24 2022] GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:43:24.633894 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-fdf62bba-efbb-4863-89e8-d15f572796e2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:24.641263 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-fdf62bba-efbb-4863-89e8-d15f572796e2 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1507 microversion: 2.1 time: 0.152521 Jun 07 08:43:24.641810 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 310/609] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:24 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:43:25.641173 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-15f8cd34-3471-4128-b152-af765c5013cb tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:25.641817 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-15f8cd34-3471-4128-b152-af765c5013cb tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:25.648185 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-15f8cd34-3471-4128-b152-af765c5013cb tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:25.648633 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-15f8cd34-3471-4128-b152-af765c5013cb tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:25.649426 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-15f8cd34-3471-4128-b152-af765c5013cb tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:25.649898 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-15f8cd34-3471-4128-b152-af765c5013cb tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:25.658483 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-48858b3f-cd14-491d-adec-65700a337931 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:25.659200 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-48858b3f-cd14-491d-adec-65700a337931 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:25.662513 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:43:25.666082 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-48858b3f-cd14-491d-adec-65700a337931 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:25.667257 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-48858b3f-cd14-491d-adec-65700a337931 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:25.668188 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-48858b3f-cd14-491d-adec-65700a337931 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:25.668808 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-48858b3f-cd14-491d-adec-65700a337931 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:25.790780 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-15f8cd34-3471-4128-b152-af765c5013cb tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:25.800637 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-15f8cd34-3471-4128-b152-af765c5013cb tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971" status: 200 len: 1362 microversion: 2.1 time: 0.163267 Jun 07 08:43:25.809976 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-48858b3f-cd14-491d-adec-65700a337931 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:25.810938 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 300/610] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:25 2022] GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:43:25.818614 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-48858b3f-cd14-491d-adec-65700a337931 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1507 microversion: 2.1 time: 0.164006 Jun 07 08:43:25.819314 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 311/611] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:25 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:43:26.817821 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-76205c23-93ca-43a7-ad96-d36c45776513 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:26.818408 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-76205c23-93ca-43a7-ad96-d36c45776513 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:26.824818 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-76205c23-93ca-43a7-ad96-d36c45776513 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:26.825316 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-76205c23-93ca-43a7-ad96-d36c45776513 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:26.826069 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-76205c23-93ca-43a7-ad96-d36c45776513 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:26.826503 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-76205c23-93ca-43a7-ad96-d36c45776513 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:26.835771 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-2a421820-f4c9-41f8-944c-6a9c26accc7b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:26.836431 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-2a421820-f4c9-41f8-944c-6a9c26accc7b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:26.843592 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2a421820-f4c9-41f8-944c-6a9c26accc7b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:26.844036 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2a421820-f4c9-41f8-944c-6a9c26accc7b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:26.844792 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2a421820-f4c9-41f8-944c-6a9c26accc7b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:26.845256 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2a421820-f4c9-41f8-944c-6a9c26accc7b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:26.957858 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-76205c23-93ca-43a7-ad96-d36c45776513 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:26.965766 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-76205c23-93ca-43a7-ad96-d36c45776513 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971" status: 200 len: 1362 microversion: 2.1 time: 0.151840 Jun 07 08:43:26.966334 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 301/612] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:26 2022] GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:43:26.975435 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-2a421820-f4c9-41f8-944c-6a9c26accc7b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:26.983487 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-2a421820-f4c9-41f8-944c-6a9c26accc7b tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1507 microversion: 2.1 time: 0.151923 Jun 07 08:43:26.988678 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 312/613] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:26 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:43:27.773398 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-bee45dd4-9304-4839-bd3c-25afe34a5978 req-46897a26-f8fd-4d3a-9ae4-15821402c909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b020097d-7d41-4338-a7a8-fe85f295435c", "name": "network-vif-deleted", "tag": "98df96b5-be22-44b0-9b8f-858fd497d562"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:43:27.782109 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-bee45dd4-9304-4839-bd3c-25afe34a5978 req-46897a26-f8fd-4d3a-9ae4-15821402c909 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:27.782549 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-bee45dd4-9304-4839-bd3c-25afe34a5978 req-46897a26-f8fd-4d3a-9ae4-15821402c909 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:27.794609 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-bee45dd4-9304-4839-bd3c-25afe34a5978 req-46897a26-f8fd-4d3a-9ae4-15821402c909 service nova] Creating event network-vif-deleted:98df96b5-be22-44b0-9b8f-858fd497d562 for instance b020097d-7d41-4338-a7a8-fe85f295435c on hv-cinder-74014 Jun 07 08:43:27.800064 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-bee45dd4-9304-4839-bd3c-25afe34a5978 req-46897a26-f8fd-4d3a-9ae4-15821402c909 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031131 Jun 07 08:43:27.800685 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 302/614] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:43:27.870147 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-45290c0f-9e74-4e8d-925c-dfd837025972 req-397d597b-dfad-42c4-a423-ff7ec6658f7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7de79795-1332-477d-a70a-f1e87b662971", "name": "network-vif-plugged", "status": "completed", "tag": "096b6e40-1995-4715-a8ed-f4a9214a3135"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:43:27.878569 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-45290c0f-9e74-4e8d-925c-dfd837025972 req-397d597b-dfad-42c4-a423-ff7ec6658f7b service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:27.879009 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-45290c0f-9e74-4e8d-925c-dfd837025972 req-397d597b-dfad-42c4-a423-ff7ec6658f7b service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:27.890765 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-45290c0f-9e74-4e8d-925c-dfd837025972 req-397d597b-dfad-42c4-a423-ff7ec6658f7b service nova] Creating event network-vif-plugged:096b6e40-1995-4715-a8ed-f4a9214a3135 for instance 7de79795-1332-477d-a70a-f1e87b662971 on hv-cinder-74014 Jun 07 08:43:27.895717 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-45290c0f-9e74-4e8d-925c-dfd837025972 req-397d597b-dfad-42c4-a423-ff7ec6658f7b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029414 Jun 07 08:43:27.897495 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 313/615] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:43:27.985424 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-fab4cf4f-cb45-468a-a223-70e811f24fb8 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:27.986147 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-fab4cf4f-cb45-468a-a223-70e811f24fb8 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:27.992493 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fab4cf4f-cb45-468a-a223-70e811f24fb8 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:27.993088 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fab4cf4f-cb45-468a-a223-70e811f24fb8 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:27.993948 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fab4cf4f-cb45-468a-a223-70e811f24fb8 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:27.994468 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fab4cf4f-cb45-468a-a223-70e811f24fb8 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:28.004142 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-597a8ac4-1186-46be-8ebe-cbdcde2c3832 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:28.005236 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-597a8ac4-1186-46be-8ebe-cbdcde2c3832 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:28.012113 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-597a8ac4-1186-46be-8ebe-cbdcde2c3832 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:28.012943 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-597a8ac4-1186-46be-8ebe-cbdcde2c3832 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:28.013821 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-597a8ac4-1186-46be-8ebe-cbdcde2c3832 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:28.014333 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-597a8ac4-1186-46be-8ebe-cbdcde2c3832 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:28.018714 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:43:28.085842 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-597a8ac4-1186-46be-8ebe-cbdcde2c3832 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:28.095612 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-597a8ac4-1186-46be-8ebe-cbdcde2c3832 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 200 len: 1293 microversion: 2.1 time: 0.095591 Jun 07 08:43:28.096452 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 314/616] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:27 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 1293 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:43:28.172053 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-fab4cf4f-cb45-468a-a223-70e811f24fb8 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:28.182494 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-fab4cf4f-cb45-468a-a223-70e811f24fb8 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971" status: 200 len: 1362 microversion: 2.1 time: 0.202470 Jun 07 08:43:28.183242 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 303/617] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:27 2022] GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971 => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:43:29.112241 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-6f0bdb6b-8ca7-4a2c-918b-abe5656fe0ec tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:29.112780 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-6f0bdb6b-8ca7-4a2c-918b-abe5656fe0ec tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: b020097d-7d41-4338-a7a8-fe85f295435c] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:29.114624 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell0:SELECT=6 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:43:29.120711 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6f0bdb6b-8ca7-4a2c-918b-abe5656fe0ec tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:29.121205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6f0bdb6b-8ca7-4a2c-918b-abe5656fe0ec tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:29.121961 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6f0bdb6b-8ca7-4a2c-918b-abe5656fe0ec tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:29.122385 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6f0bdb6b-8ca7-4a2c-918b-abe5656fe0ec tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:29.136318 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.wsgi [None req-6f0bdb6b-8ca7-4a2c-918b-abe5656fe0ec tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] HTTP exception thrown: Instance b020097d-7d41-4338-a7a8-fe85f295435c could not be found. Jun 07 08:43:29.139205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-6f0bdb6b-8ca7-4a2c-918b-abe5656fe0ec tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Request method failure captured: Jun 07 08:43:29.139205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: request: GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c HTTP/1.1 Jun 07 08:43:29.139205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept: application/json Jun 07 08:43:29.139205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept-Encoding: identity Jun 07 08:43:29.139205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Connection: close Jun 07 08:43:29.139205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Length: 0 Jun 07 08:43:29.139205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Type: application/json Jun 07 08:43:29.139205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Host: 10.222.0.17 Jun 07 08:43:29.139205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Openstack-System-Scope: None Jun 07 08:43:29.139205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: User-Agent: python-urllib3/1.26.9 Jun 07 08:43:29.139205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Auth-Token: gAAAAABinw56gFqEMZtH-I0OxhDG-zG6My9swmCke2xrKyH-Hi3vn7-umR3bhinsgBM-VBrrIJFaQdJKLbe8_s6_ve07jIkgyhtY0t3tA8s4W3pn-RsLOgTMCSA2ud98s6n92bGn7O40KljBfpr0883mO-X5ZsF73uXRGoWztv8PfwpUy-0skp0 Jun 07 08:43:29.139205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Id: None Jun 07 08:43:29.139205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Name: None Jun 07 08:43:29.139205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Identity-Status: Confirmed Jun 07 08:43:29.139205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Is-Admin-Project: True Jun 07 08:43:29.139205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Id: default Jun 07 08:43:29.139205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Name: Default Jun 07 08:43:29.139205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Id: 10b79d91933b4f7f9f32d66138e18373 Jun 07 08:43:29.139205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-311181591 Jun 07 08:43:29.139205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Role: reader,member Jun 07 08:43:29.139205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Roles: reader,member Jun 07 08:43:29.140759 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/10b79d91933b4f7f9f32d66138e18373"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/10b79d91933b4f7f9f32d66138e18373"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_10b79d91933b4f7f9f32d66138e18373", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/10b79d91933b4f7f9f32d66138e18373"}]}] Jun 07 08:43:29.140759 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant: tempest-ServerRescueNegativeTestJSON-311181591 Jun 07 08:43:29.140759 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Id: 10b79d91933b4f7f9f32d66138e18373 Jun 07 08:43:29.140759 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-311181591 Jun 07 08:43:29.140759 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User: tempest-ServerRescueNegativeTestJSON-311181591-project Jun 07 08:43:29.140759 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Id: default Jun 07 08:43:29.140759 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Name: Default Jun 07 08:43:29.140759 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Id: 055ec8a54bdf400fac0a46b0e5497f1b Jun 07 08:43:29.140759 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Name: tempest-ServerRescueNegativeTestJSON-311181591-project Jun 07 08:43:29.140759 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: method: > Jun 07 08:43:29.140759 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: exception: Instance b020097d-7d41-4338-a7a8-fe85f295435c could not be found. Jun 07 08:43:29.140759 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: action_args: {'id': 'b020097d-7d41-4338-a7a8-fe85f295435c'} Jun 07 08:43:29.141639 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:43:29.141639 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:43:29.141639 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:43:29.141639 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:43:29.141639 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:43:29.141639 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:43:29.141639 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:43:29.141639 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:43:29.141639 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:43:29.141639 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:43:29.141639 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b020097d-7d41-4338-a7a8-fe85f295435c could not be found. Jun 07 08:43:29.141639 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:43:29.141639 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:43:29.141639 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:43:29.141639 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:43:29.141639 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:43:29.141639 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:43:29.141639 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:43:29.141639 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:43:29.141639 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:43:29.142952 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:43:29.142952 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 08:43:29.142952 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 08:43:29.142952 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:43:29.142952 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:43:29.142952 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:43:29.142952 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:43:29.142952 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b020097d-7d41-4338-a7a8-fe85f295435c could not be found. Jun 07 08:43:29.142952 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:43:29.142952 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:43:29.142952 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:43:29.142952 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:43:29.142952 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:43:29.142952 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:43:29.142952 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:43:29.142952 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:43:29.142952 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b020097d-7d41-4338-a7a8-fe85f295435c could not be found. Jun 07 08:43:29.142952 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:43:29.144204 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-6f0bdb6b-8ca7-4a2c-918b-abe5656fe0ec tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Returning 404 to user: Instance b020097d-7d41-4338-a7a8-fe85f295435c could not be found. {{(pid=129725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:43:29.144204 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-6f0bdb6b-8ca7-4a2c-918b-abe5656fe0ec tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c" status: 404 len: 111 microversion: 2.1 time: 0.031372 Jun 07 08:43:29.144204 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 315/618] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:29 2022] GET /compute/v2.1/servers/b020097d-7d41-4338-a7a8-fe85f295435c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:43:29.147912 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-8b0e4586-36bc-41f7-968c-724c047f97fc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:29.148412 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-8b0e4586-36bc-41f7-968c-724c047f97fc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:29.150401 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell0:SELECT=2 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:43:29.151618 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell0:SELECT=6 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:43:29.157133 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8b0e4586-36bc-41f7-968c-724c047f97fc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:29.157586 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8b0e4586-36bc-41f7-968c-724c047f97fc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:29.158345 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8b0e4586-36bc-41f7-968c-724c047f97fc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:29.158782 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8b0e4586-36bc-41f7-968c-724c047f97fc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:29.183852 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-8b0e4586-36bc-41f7-968c-724c047f97fc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Going to try to terminate instance {{(pid=129726) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 08:43:29.199546 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-2f8b2f95-6139-4033-a5d0-f812cebe25b3 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:29.200151 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-2f8b2f95-6139-4033-a5d0-f812cebe25b3 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:29.206673 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2f8b2f95-6139-4033-a5d0-f812cebe25b3 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:29.207208 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2f8b2f95-6139-4033-a5d0-f812cebe25b3 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:29.207966 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2f8b2f95-6139-4033-a5d0-f812cebe25b3 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:29.208396 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2f8b2f95-6139-4033-a5d0-f812cebe25b3 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:29.355270 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-2f8b2f95-6139-4033-a5d0-f812cebe25b3 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:29.362740 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-2f8b2f95-6139-4033-a5d0-f812cebe25b3 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971" status: 200 len: 1362 microversion: 2.1 time: 0.167048 Jun 07 08:43:29.363285 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 316/619] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:29 2022] GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:43:29.507316 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-8b0e4586-36bc-41f7-968c-724c047f97fc tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 204 len: 0 microversion: 2.1 time: 0.362888 Jun 07 08:43:29.507906 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 304/620] 10.222.0.17 () {58 vars in 1238 bytes} [Tue Jun 7 08:43:29 2022] DELETE /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 08:43:29.516271 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-5057d4ee-7817-44f8-a78b-a946695fae3a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:29.516878 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-5057d4ee-7817-44f8-a78b-a946695fae3a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:29.523104 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5057d4ee-7817-44f8-a78b-a946695fae3a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:29.523546 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5057d4ee-7817-44f8-a78b-a946695fae3a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:29.524294 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5057d4ee-7817-44f8-a78b-a946695fae3a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:29.524724 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5057d4ee-7817-44f8-a78b-a946695fae3a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:29.657158 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-5057d4ee-7817-44f8-a78b-a946695fae3a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:29.665122 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-5057d4ee-7817-44f8-a78b-a946695fae3a tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.152629 Jun 07 08:43:29.665694 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 317/621] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:29 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:43:30.379537 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-c903ffbd-8522-44b6-a2a5-116b2027daad tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:30.380160 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-c903ffbd-8522-44b6-a2a5-116b2027daad tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:30.386937 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c903ffbd-8522-44b6-a2a5-116b2027daad tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:30.387387 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c903ffbd-8522-44b6-a2a5-116b2027daad tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:30.388138 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c903ffbd-8522-44b6-a2a5-116b2027daad tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:30.388566 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c903ffbd-8522-44b6-a2a5-116b2027daad tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:30.527635 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-c903ffbd-8522-44b6-a2a5-116b2027daad tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:30.535387 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-c903ffbd-8522-44b6-a2a5-116b2027daad tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971" status: 200 len: 1362 microversion: 2.1 time: 0.160511 Jun 07 08:43:30.535953 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 305/622] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:30 2022] GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:43:30.682449 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-3f7fdb91-0451-48cd-a956-86673deae260 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:30.683056 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-3f7fdb91-0451-48cd-a956-86673deae260 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:30.689447 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3f7fdb91-0451-48cd-a956-86673deae260 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:30.689895 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3f7fdb91-0451-48cd-a956-86673deae260 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:30.690645 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3f7fdb91-0451-48cd-a956-86673deae260 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:30.691076 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3f7fdb91-0451-48cd-a956-86673deae260 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:30.819039 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-3f7fdb91-0451-48cd-a956-86673deae260 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:30.827719 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-3f7fdb91-0451-48cd-a956-86673deae260 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.149437 Jun 07 08:43:30.828436 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 318/623] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:30 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:43:31.552225 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-e360f822-fd4b-4f5c-bc90-db8a54c3bc18 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:31.552835 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-e360f822-fd4b-4f5c-bc90-db8a54c3bc18 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:31.559324 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e360f822-fd4b-4f5c-bc90-db8a54c3bc18 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:31.559770 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e360f822-fd4b-4f5c-bc90-db8a54c3bc18 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:31.560529 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e360f822-fd4b-4f5c-bc90-db8a54c3bc18 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:31.560961 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e360f822-fd4b-4f5c-bc90-db8a54c3bc18 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:31.687433 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-e360f822-fd4b-4f5c-bc90-db8a54c3bc18 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:31.694974 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-e360f822-fd4b-4f5c-bc90-db8a54c3bc18 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971" status: 200 len: 1362 microversion: 2.1 time: 0.146548 Jun 07 08:43:31.695540 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 306/624] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:31 2022] GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:43:31.847465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-547d88ea-1c44-46bb-8fcc-c4460fba6c19 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:31.848003 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-547d88ea-1c44-46bb-8fcc-c4460fba6c19 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:31.854555 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-547d88ea-1c44-46bb-8fcc-c4460fba6c19 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:31.855009 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-547d88ea-1c44-46bb-8fcc-c4460fba6c19 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:31.855771 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-547d88ea-1c44-46bb-8fcc-c4460fba6c19 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:31.856212 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-547d88ea-1c44-46bb-8fcc-c4460fba6c19 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:31.994824 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-547d88ea-1c44-46bb-8fcc-c4460fba6c19 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:31.997063 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-547d88ea-1c44-46bb-8fcc-c4460fba6c19 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.153563 Jun 07 08:43:31.997628 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 319/625] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:31 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:43:32.711762 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-6484a128-2438-4ab5-b9d9-87f83c23b846 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:32.712377 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-6484a128-2438-4ab5-b9d9-87f83c23b846 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:32.719656 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6484a128-2438-4ab5-b9d9-87f83c23b846 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:32.720107 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6484a128-2438-4ab5-b9d9-87f83c23b846 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:32.720863 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6484a128-2438-4ab5-b9d9-87f83c23b846 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:32.721383 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6484a128-2438-4ab5-b9d9-87f83c23b846 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:32.857644 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-6484a128-2438-4ab5-b9d9-87f83c23b846 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:32.865089 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-6484a128-2438-4ab5-b9d9-87f83c23b846 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971" status: 200 len: 1362 microversion: 2.1 time: 0.157286 Jun 07 08:43:32.865655 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 307/626] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:32 2022] GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:43:32.904752 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-b1d7abeb-3846-4aca-8bfd-b8996ffd5216 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-822756039"}} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:43:32.905619 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-b1d7abeb-3846-4aca-8bfd-b8996ffd5216 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:32.912106 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b1d7abeb-3846-4aca-8bfd-b8996ffd5216 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:32.914580 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b1d7abeb-3846-4aca-8bfd-b8996ffd5216 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:32.914580 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b1d7abeb-3846-4aca-8bfd-b8996ffd5216 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:32.914580 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b1d7abeb-3846-4aca-8bfd-b8996ffd5216 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:33.014709 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-e8b89bed-9490-47c5-8df1-185bad690209 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:33.015617 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-e8b89bed-9490-47c5-8df1-185bad690209 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:33.021714 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e8b89bed-9490-47c5-8df1-185bad690209 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:33.023514 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e8b89bed-9490-47c5-8df1-185bad690209 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:33.023514 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e8b89bed-9490-47c5-8df1-185bad690209 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:33.023514 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e8b89bed-9490-47c5-8df1-185bad690209 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:33.043333 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.network.security_group_api [None req-b1d7abeb-3846-4aca-8bfd-b8996ffd5216 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Removing security group 6c5aad48-f650-47a3-85d4-ed8bb2fa1526 from port 97a8e43e-a795-4fed-8696-2a901df6519b Jun 07 08:43:33.154790 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-e8b89bed-9490-47c5-8df1-185bad690209 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:33.162804 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-e8b89bed-9490-47c5-8df1-185bad690209 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1521 microversion: 2.1 time: 0.152508 Jun 07 08:43:33.163374 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 308/627] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:33 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:43:33.638593 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-b1d7abeb-3846-4aca-8bfd-b8996ffd5216 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "POST /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db/action" status: 202 len: 0 microversion: 2.1 time: 0.737671 Jun 07 08:43:33.639212 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 320/628] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jun 7 08:43:32 2022] POST /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db/action => generated 0 bytes in 739 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 08:43:33.660770 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-eaa3adef-fdde-4b2a-b25e-c55e88d03ca5 req-34c1eb28-1f74-4df3-b2d1-099d54ed1bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b308a6f5-2c8d-45ad-ace4-9b623bfa76db", "tag": "97a8e43e-a795-4fed-8696-2a901df6519b"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:43:33.671910 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-eaa3adef-fdde-4b2a-b25e-c55e88d03ca5 req-34c1eb28-1f74-4df3-b2d1-099d54ed1bc1 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:33.672358 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-eaa3adef-fdde-4b2a-b25e-c55e88d03ca5 req-34c1eb28-1f74-4df3-b2d1-099d54ed1bc1 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:33.692005 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-eaa3adef-fdde-4b2a-b25e-c55e88d03ca5 req-34c1eb28-1f74-4df3-b2d1-099d54ed1bc1 service nova] Creating event network-changed:97a8e43e-a795-4fed-8696-2a901df6519b for instance b308a6f5-2c8d-45ad-ace4-9b623bfa76db on hv-cinder-74014 Jun 07 08:43:33.715406 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-eaa3adef-fdde-4b2a-b25e-c55e88d03ca5 req-34c1eb28-1f74-4df3-b2d1-099d54ed1bc1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058318 Jun 07 08:43:33.717016 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 309/629] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:43:33.888408 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-691eac5e-438a-4fe4-bb31-be2b6b62032c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:33.888408 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-691eac5e-438a-4fe4-bb31-be2b6b62032c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:33.891238 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-691eac5e-438a-4fe4-bb31-be2b6b62032c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:33.891766 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-691eac5e-438a-4fe4-bb31-be2b6b62032c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:33.892660 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-691eac5e-438a-4fe4-bb31-be2b6b62032c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:33.893249 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-691eac5e-438a-4fe4-bb31-be2b6b62032c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:34.180598 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-4b1bacc7-67e8-42e2-8bfb-8477bc6dc74d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:34.181326 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-4b1bacc7-67e8-42e2-8bfb-8477bc6dc74d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:34.187878 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4b1bacc7-67e8-42e2-8bfb-8477bc6dc74d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:34.188328 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4b1bacc7-67e8-42e2-8bfb-8477bc6dc74d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:34.189141 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4b1bacc7-67e8-42e2-8bfb-8477bc6dc74d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:34.189585 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4b1bacc7-67e8-42e2-8bfb-8477bc6dc74d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:34.211501 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:43:34.275861 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-691eac5e-438a-4fe4-bb31-be2b6b62032c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:34.278393 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-4b1bacc7-67e8-42e2-8bfb-8477bc6dc74d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:34.284324 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-691eac5e-438a-4fe4-bb31-be2b6b62032c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971" status: 200 len: 1547 microversion: 2.1 time: 0.406116 Jun 07 08:43:34.285203 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 321/630] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:33 2022] GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971 => generated 1547 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:43:34.287822 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-4b1bacc7-67e8-42e2-8bfb-8477bc6dc74d tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1479 microversion: 2.1 time: 0.111734 Jun 07 08:43:34.297444 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 310/631] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:34 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1479 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:43:34.300840 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-d0d9883e-09ed-4cff-8ddd-70330e2f7c0f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:34.301489 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-d0d9883e-09ed-4cff-8ddd-70330e2f7c0f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:34.311056 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d0d9883e-09ed-4cff-8ddd-70330e2f7c0f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:34.311056 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d0d9883e-09ed-4cff-8ddd-70330e2f7c0f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:34.311056 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d0d9883e-09ed-4cff-8ddd-70330e2f7c0f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:34.311056 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d0d9883e-09ed-4cff-8ddd-70330e2f7c0f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:34.460060 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-d0d9883e-09ed-4cff-8ddd-70330e2f7c0f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.163341 Jun 07 08:43:34.460782 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 322/632] 10.222.0.17 () {58 vars in 1274 bytes} [Tue Jun 7 08:43:34 2022] GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:43:35.305945 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-7e6ae0cf-e54a-44ea-b4b6-cbcecebff64f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:35.310331 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-7e6ae0cf-e54a-44ea-b4b6-cbcecebff64f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:35.320165 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7e6ae0cf-e54a-44ea-b4b6-cbcecebff64f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:35.320886 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7e6ae0cf-e54a-44ea-b4b6-cbcecebff64f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:35.322051 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7e6ae0cf-e54a-44ea-b4b6-cbcecebff64f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:35.323306 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7e6ae0cf-e54a-44ea-b4b6-cbcecebff64f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:35.358598 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7e6ae0cf-e54a-44ea-b4b6-cbcecebff64f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:35.359048 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7e6ae0cf-e54a-44ea-b4b6-cbcecebff64f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:35.359510 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.objects.instance [None req-7e6ae0cf-e54a-44ea-b4b6-cbcecebff64f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lazy-loading 'fault' on Instance uuid d40b0293-76f4-4ef2-9bfa-dda971ade7ea {{(pid=129726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:43:35.428415 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-7e6ae0cf-e54a-44ea-b4b6-cbcecebff64f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '055ec8a54bdf400fac0a46b0e5497f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b79d91933b4f7f9f32d66138e18373', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:35.440503 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-7e6ae0cf-e54a-44ea-b4b6-cbcecebff64f tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 200 len: 1311 microversion: 2.1 time: 0.139009 Jun 07 08:43:35.450618 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 311/633] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:35 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 1311 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:43:35.683433 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-0131ed5c-b751-44f3-842d-af9f462b497f req-8719fd1b-b9bb-4abb-b486-8ed97e5979ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7de79795-1332-477d-a70a-f1e87b662971", "tag": "096b6e40-1995-4715-a8ed-f4a9214a3135"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:43:35.692468 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-0131ed5c-b751-44f3-842d-af9f462b497f req-8719fd1b-b9bb-4abb-b486-8ed97e5979ce service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:35.692915 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-0131ed5c-b751-44f3-842d-af9f462b497f req-8719fd1b-b9bb-4abb-b486-8ed97e5979ce service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:35.697685 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-53b3763d-26ed-4d61-a689-e1605301d4a9 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:35.698368 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-53b3763d-26ed-4d61-a689-e1605301d4a9 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:35.704651 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-0131ed5c-b751-44f3-842d-af9f462b497f req-8719fd1b-b9bb-4abb-b486-8ed97e5979ce service nova] Creating event network-changed:096b6e40-1995-4715-a8ed-f4a9214a3135 for instance 7de79795-1332-477d-a70a-f1e87b662971 on hv-cinder-74014 Jun 07 08:43:35.705273 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-53b3763d-26ed-4d61-a689-e1605301d4a9 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:35.706012 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-53b3763d-26ed-4d61-a689-e1605301d4a9 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:35.707193 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-53b3763d-26ed-4d61-a689-e1605301d4a9 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:35.707902 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-53b3763d-26ed-4d61-a689-e1605301d4a9 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:35.710160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-0131ed5c-b751-44f3-842d-af9f462b497f req-8719fd1b-b9bb-4abb-b486-8ed97e5979ce service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088318 Jun 07 08:43:35.710879 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 323/634] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:43:35.852124 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.objects.instance [None req-53b3763d-26ed-4d61-a689-e1605301d4a9 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lazy-loading 'services' on Instance uuid b308a6f5-2c8d-45ad-ace4-9b623bfa76db {{(pid=129726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:43:35.871239 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-20e14e9d-bfd2-4561-af43-15ede5093f7a req-d33dd313-e6d6-40c9-9893-a386b9083544 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d40b0293-76f4-4ef2-9bfa-dda971ade7ea", "name": "network-vif-deleted", "tag": "eb0afe08-4df3-4618-8c1a-99dacff66959"}, {"name": "network-changed", "server_uuid": "b308a6f5-2c8d-45ad-ace4-9b623bfa76db", "tag": "97a8e43e-a795-4fed-8696-2a901df6519b"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:43:35.887602 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-20e14e9d-bfd2-4561-af43-15ede5093f7a req-d33dd313-e6d6-40c9-9893-a386b9083544 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:35.888020 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-20e14e9d-bfd2-4561-af43-15ede5093f7a req-d33dd313-e6d6-40c9-9893-a386b9083544 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:35.918938 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-20e14e9d-bfd2-4561-af43-15ede5093f7a req-d33dd313-e6d6-40c9-9893-a386b9083544 service nova] Creating event network-vif-deleted:eb0afe08-4df3-4618-8c1a-99dacff66959 for instance d40b0293-76f4-4ef2-9bfa-dda971ade7ea on hv-cinder-74014 Jun 07 08:43:35.919831 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-20e14e9d-bfd2-4561-af43-15ede5093f7a req-d33dd313-e6d6-40c9-9893-a386b9083544 service nova] Creating event network-changed:97a8e43e-a795-4fed-8696-2a901df6519b for instance b308a6f5-2c8d-45ad-ace4-9b623bfa76db on hv-cinder-74014 Jun 07 08:43:35.935391 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-20e14e9d-bfd2-4561-af43-15ede5093f7a req-d33dd313-e6d6-40c9-9893-a386b9083544 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.174395 Jun 07 08:43:35.949767 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 324/635] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:43:36.142672 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-53b3763d-26ed-4d61-a689-e1605301d4a9 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db/os-volume_attachments/cfcc8093-adc1-4747-8eb1-dd11c062a012" status: 202 len: 0 microversion: 2.1 time: 0.449093 Jun 07 08:43:36.159743 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 312/636] 10.222.0.17 () {58 vars in 1415 bytes} [Tue Jun 7 08:43:35 2022] DELETE /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db/os-volume_attachments/cfcc8093-adc1-4747-8eb1-dd11c062a012 => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 08:43:36.161110 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-d1b6dcc2-d53d-42ec-984a-013a1c460f6a tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:36.163122 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-d1b6dcc2-d53d-42ec-984a-013a1c460f6a tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:36.175104 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d1b6dcc2-d53d-42ec-984a-013a1c460f6a tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:36.175870 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d1b6dcc2-d53d-42ec-984a-013a1c460f6a tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:36.179084 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d1b6dcc2-d53d-42ec-984a-013a1c460f6a tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:36.179084 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d1b6dcc2-d53d-42ec-984a-013a1c460f6a tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:36.220670 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-d1b6dcc2-d53d-42ec-984a-013a1c460f6a tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069656 Jun 07 08:43:36.226119 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 325/637] 10.222.0.17 () {58 vars in 1301 bytes} [Tue Jun 7 08:43:36 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:43:36.462692 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-f902d12a-49dd-4b27-842e-c507929eb4b1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:36.463990 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-f902d12a-49dd-4b27-842e-c507929eb4b1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] [instance: d40b0293-76f4-4ef2-9bfa-dda971ade7ea] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:36.473415 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f902d12a-49dd-4b27-842e-c507929eb4b1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:36.474898 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f902d12a-49dd-4b27-842e-c507929eb4b1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:36.475604 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f902d12a-49dd-4b27-842e-c507929eb4b1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:36.476841 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f902d12a-49dd-4b27-842e-c507929eb4b1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:36.491035 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.wsgi [None req-f902d12a-49dd-4b27-842e-c507929eb4b1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] HTTP exception thrown: Instance d40b0293-76f4-4ef2-9bfa-dda971ade7ea could not be found. Jun 07 08:43:36.492709 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-f902d12a-49dd-4b27-842e-c507929eb4b1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Request method failure captured: Jun 07 08:43:36.492709 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: request: GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea HTTP/1.1 Jun 07 08:43:36.492709 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept: application/json Jun 07 08:43:36.492709 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept-Encoding: identity Jun 07 08:43:36.492709 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Connection: close Jun 07 08:43:36.492709 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Length: 0 Jun 07 08:43:36.492709 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Type: application/json Jun 07 08:43:36.492709 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Host: 10.222.0.17 Jun 07 08:43:36.492709 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Openstack-System-Scope: None Jun 07 08:43:36.492709 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: User-Agent: python-urllib3/1.26.9 Jun 07 08:43:36.492709 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Auth-Token: gAAAAABinw56gFqEMZtH-I0OxhDG-zG6My9swmCke2xrKyH-Hi3vn7-umR3bhinsgBM-VBrrIJFaQdJKLbe8_s6_ve07jIkgyhtY0t3tA8s4W3pn-RsLOgTMCSA2ud98s6n92bGn7O40KljBfpr0883mO-X5ZsF73uXRGoWztv8PfwpUy-0skp0 Jun 07 08:43:36.492709 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Id: None Jun 07 08:43:36.492709 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Name: None Jun 07 08:43:36.492709 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Identity-Status: Confirmed Jun 07 08:43:36.492709 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Is-Admin-Project: True Jun 07 08:43:36.492709 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Id: default Jun 07 08:43:36.492709 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Name: Default Jun 07 08:43:36.492709 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Id: 10b79d91933b4f7f9f32d66138e18373 Jun 07 08:43:36.492709 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-311181591 Jun 07 08:43:36.492709 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Role: reader,member Jun 07 08:43:36.492709 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Roles: reader,member Jun 07 08:43:36.494074 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/10b79d91933b4f7f9f32d66138e18373"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/10b79d91933b4f7f9f32d66138e18373"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_10b79d91933b4f7f9f32d66138e18373", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/10b79d91933b4f7f9f32d66138e18373"}]}] Jun 07 08:43:36.494074 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant: tempest-ServerRescueNegativeTestJSON-311181591 Jun 07 08:43:36.494074 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Id: 10b79d91933b4f7f9f32d66138e18373 Jun 07 08:43:36.494074 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-311181591 Jun 07 08:43:36.494074 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User: tempest-ServerRescueNegativeTestJSON-311181591-project Jun 07 08:43:36.494074 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Id: default Jun 07 08:43:36.494074 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Name: Default Jun 07 08:43:36.494074 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Id: 055ec8a54bdf400fac0a46b0e5497f1b Jun 07 08:43:36.494074 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Name: tempest-ServerRescueNegativeTestJSON-311181591-project Jun 07 08:43:36.494074 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: method: > Jun 07 08:43:36.494074 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: exception: Instance d40b0293-76f4-4ef2-9bfa-dda971ade7ea could not be found. Jun 07 08:43:36.494074 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: action_args: {'id': 'd40b0293-76f4-4ef2-9bfa-dda971ade7ea'} Jun 07 08:43:36.495309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:43:36.495309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:43:36.495309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:43:36.495309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:43:36.495309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:43:36.495309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:43:36.495309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:43:36.495309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:43:36.495309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:43:36.495309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:43:36.495309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d40b0293-76f4-4ef2-9bfa-dda971ade7ea could not be found. Jun 07 08:43:36.495309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:43:36.495309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:43:36.495309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:43:36.495309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:43:36.495309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:43:36.495309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:43:36.495309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:43:36.495309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:43:36.495309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:43:36.496441 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:43:36.496441 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 08:43:36.496441 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 08:43:36.496441 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:43:36.496441 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:43:36.496441 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:43:36.496441 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:43:36.496441 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d40b0293-76f4-4ef2-9bfa-dda971ade7ea could not be found. Jun 07 08:43:36.496441 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:43:36.496441 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:43:36.496441 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:43:36.496441 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:43:36.496441 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:43:36.496441 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:43:36.496441 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:43:36.496441 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:43:36.496441 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d40b0293-76f4-4ef2-9bfa-dda971ade7ea could not be found. Jun 07 08:43:36.496441 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:43:36.497632 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-f902d12a-49dd-4b27-842e-c507929eb4b1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] Returning 404 to user: Instance d40b0293-76f4-4ef2-9bfa-dda971ade7ea could not be found. {{(pid=129726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:43:36.497632 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-f902d12a-49dd-4b27-842e-c507929eb4b1 tempest-ServerRescueNegativeTestJSON-311181591 tempest-ServerRescueNegativeTestJSON-311181591-project] 10.222.0.17 "GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea" status: 404 len: 111 microversion: 2.1 time: 0.040269 Jun 07 08:43:36.497632 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 313/638] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:36 2022] GET /compute/v2.1/servers/d40b0293-76f4-4ef2-9bfa-dda971ade7ea => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:43:37.235034 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-7dc392ba-b253-42c6-a34c-bf45a269a126 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:37.237311 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-7dc392ba-b253-42c6-a34c-bf45a269a126 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:37.265129 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7dc392ba-b253-42c6-a34c-bf45a269a126 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:37.265778 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7dc392ba-b253-42c6-a34c-bf45a269a126 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:37.267091 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7dc392ba-b253-42c6-a34c-bf45a269a126 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:37.267537 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7dc392ba-b253-42c6-a34c-bf45a269a126 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:37.315512 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-7dc392ba-b253-42c6-a34c-bf45a269a126 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085568 Jun 07 08:43:37.316446 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 326/639] 10.222.0.17 () {58 vars in 1301 bytes} [Tue Jun 7 08:43:37 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:43:38.328074 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-48eb1838-12fe-43ac-8c82-dbc11fcd4c00 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:38.328957 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-48eb1838-12fe-43ac-8c82-dbc11fcd4c00 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:38.335492 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-48eb1838-12fe-43ac-8c82-dbc11fcd4c00 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:38.335941 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-48eb1838-12fe-43ac-8c82-dbc11fcd4c00 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:38.336712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-48eb1838-12fe-43ac-8c82-dbc11fcd4c00 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:38.337181 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-48eb1838-12fe-43ac-8c82-dbc11fcd4c00 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:38.365006 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-48eb1838-12fe-43ac-8c82-dbc11fcd4c00 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040928 Jun 07 08:43:38.365579 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 314/640] 10.222.0.17 () {58 vars in 1301 bytes} [Tue Jun 7 08:43:38 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 08:43:38.377204 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-4e1ecd41-2f59-46f5-87b2-5916f761eaf1 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:38.377872 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-4e1ecd41-2f59-46f5-87b2-5916f761eaf1 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:38.385825 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4e1ecd41-2f59-46f5-87b2-5916f761eaf1 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:38.386276 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4e1ecd41-2f59-46f5-87b2-5916f761eaf1 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:38.387309 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4e1ecd41-2f59-46f5-87b2-5916f761eaf1 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:38.387943 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4e1ecd41-2f59-46f5-87b2-5916f761eaf1 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:38.469333 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.wsgi [None req-4e1ecd41-2f59-46f5-87b2-5916f761eaf1 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] HTTP exception thrown: Instance b308a6f5-2c8d-45ad-ace4-9b623bfa76db is not attached to volume cfcc8093-adc1-4747-8eb1-dd11c062a012 Jun 07 08:43:38.482703 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-4e1ecd41-2f59-46f5-87b2-5916f761eaf1 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Request method failure captured: Jun 07 08:43:38.482703 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: request: DELETE /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db/os-volume_attachments/cfcc8093-adc1-4747-8eb1-dd11c062a012 HTTP/1.1 Jun 07 08:43:38.482703 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept: application/json Jun 07 08:43:38.482703 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept-Encoding: identity Jun 07 08:43:38.482703 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Connection: close Jun 07 08:43:38.482703 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Length: 0 Jun 07 08:43:38.482703 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Type: application/json Jun 07 08:43:38.482703 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Host: 10.222.0.17 Jun 07 08:43:38.482703 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Openstack-System-Scope: None Jun 07 08:43:38.482703 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: User-Agent: python-urllib3/1.26.9 Jun 07 08:43:38.482703 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Auth-Token: gAAAAABinw8eY8vQ9FmIMhgTOCCCYbXtxGu0fn8jRsiiBJZUTqsRuUI2BbMC1MZinRlXm22sdDHvOg8qZzOccFegDOxmybaKOM9VqZtpBx5rNSedlrfhv6hm--YO5uMSW_WKYUVlmwI4JMunryb4iAA3vwbSsS8UBZmjV-PE0kw0VQsmv9ez6c4 Jun 07 08:43:38.482703 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Id: None Jun 07 08:43:38.482703 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Name: None Jun 07 08:43:38.482703 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Identity-Status: Confirmed Jun 07 08:43:38.482703 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Is-Admin-Project: True Jun 07 08:43:38.482703 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Id: default Jun 07 08:43:38.482703 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Name: Default Jun 07 08:43:38.482703 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Id: 1e49af480c6c4449b329b5e71904b17c Jun 07 08:43:38.482703 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Name: tempest-TestMinimumBasicScenario-371020669 Jun 07 08:43:38.482703 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Role: reader,member Jun 07 08:43:38.482703 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Roles: reader,member Jun 07 08:43:38.484218 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1e49af480c6c4449b329b5e71904b17c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1e49af480c6c4449b329b5e71904b17c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1e49af480c6c4449b329b5e71904b17c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1e49af480c6c4449b329b5e71904b17c"}]}] Jun 07 08:43:38.484218 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant: tempest-TestMinimumBasicScenario-371020669 Jun 07 08:43:38.484218 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Id: 1e49af480c6c4449b329b5e71904b17c Jun 07 08:43:38.484218 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Name: tempest-TestMinimumBasicScenario-371020669 Jun 07 08:43:38.484218 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User: tempest-TestMinimumBasicScenario-371020669-project Jun 07 08:43:38.484218 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Id: default Jun 07 08:43:38.484218 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Name: Default Jun 07 08:43:38.484218 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Id: 3bbc17dea01a41ad9ca61bc65ed59cf6 Jun 07 08:43:38.484218 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Name: tempest-TestMinimumBasicScenario-371020669-project Jun 07 08:43:38.484218 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: method: > Jun 07 08:43:38.484218 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: exception: Instance b308a6f5-2c8d-45ad-ace4-9b623bfa76db is not attached to volume cfcc8093-adc1-4747-8eb1-dd11c062a012 Jun 07 08:43:38.484922 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: action_args: {'server_id': 'b308a6f5-2c8d-45ad-ace4-9b623bfa76db', 'id': 'cfcc8093-adc1-4747-8eb1-dd11c062a012'} Jun 07 08:43:38.484922 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:43:38.484922 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:43:38.484922 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 07 08:43:38.484922 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 07 08:43:38.484922 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 07 08:43:38.484922 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 07 08:43:38.484922 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 07 08:43:38.484922 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 07 08:43:38.484922 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id cfcc8093-adc1-4747-8eb1-dd11c062a012. Jun 07 08:43:38.484922 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:43:38.484922 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:43:38.484922 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:43:38.484922 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:43:38.484922 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:43:38.484922 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:43:38.484922 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:43:38.484922 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:43:38.484922 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:43:38.486368 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:43:38.486368 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 07 08:43:38.486368 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 07 08:43:38.486368 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b308a6f5-2c8d-45ad-ace4-9b623bfa76db is not attached to volume cfcc8093-adc1-4747-8eb1-dd11c062a012 Jun 07 08:43:38.486368 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:43:38.486368 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:43:38.486368 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:43:38.486368 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:43:38.486368 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:43:38.486368 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:43:38.486368 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:43:38.486368 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:43:38.486368 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b308a6f5-2c8d-45ad-ace4-9b623bfa76db is not attached to volume cfcc8093-adc1-4747-8eb1-dd11c062a012 Jun 07 08:43:38.486368 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:43:38.486368 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-4e1ecd41-2f59-46f5-87b2-5916f761eaf1 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Returning 404 to user: Instance b308a6f5-2c8d-45ad-ace4-9b623bfa76db is not attached to volume cfcc8093-adc1-4747-8eb1-dd11c062a012 {{(pid=129725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:43:38.487341 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-4e1ecd41-2f59-46f5-87b2-5916f761eaf1 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db/os-volume_attachments/cfcc8093-adc1-4747-8eb1-dd11c062a012" status: 404 len: 154 microversion: 2.1 time: 0.111842 Jun 07 08:43:38.488033 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 327/641] 10.222.0.17 () {58 vars in 1415 bytes} [Tue Jun 7 08:43:38 2022] DELETE /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db/os-volume_attachments/cfcc8093-adc1-4747-8eb1-dd11c062a012 => generated 154 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 08:43:39.764471 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-10bef111-cd4e-4e15-8457-a83bd4ad8b3d tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:39.764960 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-10bef111-cd4e-4e15-8457-a83bd4ad8b3d tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:39.772340 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-10bef111-cd4e-4e15-8457-a83bd4ad8b3d tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:39.772787 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-10bef111-cd4e-4e15-8457-a83bd4ad8b3d tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:39.773584 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-10bef111-cd4e-4e15-8457-a83bd4ad8b3d tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:39.774084 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-10bef111-cd4e-4e15-8457-a83bd4ad8b3d tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:39.801244 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-10bef111-cd4e-4e15-8457-a83bd4ad8b3d tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Going to try to terminate instance {{(pid=129726) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 08:43:40.123792 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-10bef111-cd4e-4e15-8457-a83bd4ad8b3d tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 204 len: 0 microversion: 2.1 time: 0.363785 Jun 07 08:43:40.126649 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 315/642] 10.222.0.17 () {58 vars in 1238 bytes} [Tue Jun 7 08:43:39 2022] DELETE /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 08:43:40.144009 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-9e4c1ea5-a670-465d-95da-37a9e2370549 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:40.145193 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-9e4c1ea5-a670-465d-95da-37a9e2370549 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:40.152180 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9e4c1ea5-a670-465d-95da-37a9e2370549 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:40.152906 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9e4c1ea5-a670-465d-95da-37a9e2370549 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:40.153870 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9e4c1ea5-a670-465d-95da-37a9e2370549 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:40.154489 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9e4c1ea5-a670-465d-95da-37a9e2370549 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:40.329802 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-9e4c1ea5-a670-465d-95da-37a9e2370549 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:40.342487 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-9e4c1ea5-a670-465d-95da-37a9e2370549 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1553 microversion: 2.1 time: 0.204232 Jun 07 08:43:40.343952 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 328/643] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:40 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1553 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:43:41.360082 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-d6c9f05f-28ff-4005-b635-8ecab5b0d234 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:41.360901 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-d6c9f05f-28ff-4005-b635-8ecab5b0d234 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:41.363403 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:43:41.368321 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d6c9f05f-28ff-4005-b635-8ecab5b0d234 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:41.368779 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d6c9f05f-28ff-4005-b635-8ecab5b0d234 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:41.370087 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d6c9f05f-28ff-4005-b635-8ecab5b0d234 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:41.370587 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d6c9f05f-28ff-4005-b635-8ecab5b0d234 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:41.507066 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-d6c9f05f-28ff-4005-b635-8ecab5b0d234 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:41.514893 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-d6c9f05f-28ff-4005-b635-8ecab5b0d234 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1553 microversion: 2.1 time: 0.158950 Jun 07 08:43:41.515454 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 316/644] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:41 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:43:42.534939 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-28ddd3a3-bc18-43d4-b60d-77ba0df16662 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:42.536377 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-28ddd3a3-bc18-43d4-b60d-77ba0df16662 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:42.542849 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-28ddd3a3-bc18-43d4-b60d-77ba0df16662 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:42.543570 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-28ddd3a3-bc18-43d4-b60d-77ba0df16662 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:42.544688 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-28ddd3a3-bc18-43d4-b60d-77ba0df16662 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:42.545375 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-28ddd3a3-bc18-43d4-b60d-77ba0df16662 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:42.564873 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-323a78d3-004f-49bd-9a63-286c8039885c req-75085cee-8e5f-4c82-ac24-4ed1e81ea754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b308a6f5-2c8d-45ad-ace4-9b623bfa76db", "name": "network-vif-deleted", "tag": "97a8e43e-a795-4fed-8696-2a901df6519b"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:43:42.576199 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-323a78d3-004f-49bd-9a63-286c8039885c req-75085cee-8e5f-4c82-ac24-4ed1e81ea754 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:42.576875 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-323a78d3-004f-49bd-9a63-286c8039885c req-75085cee-8e5f-4c82-ac24-4ed1e81ea754 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:42.589853 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-323a78d3-004f-49bd-9a63-286c8039885c req-75085cee-8e5f-4c82-ac24-4ed1e81ea754 service nova] Creating event network-vif-deleted:97a8e43e-a795-4fed-8696-2a901df6519b for instance b308a6f5-2c8d-45ad-ace4-9b623bfa76db on hv-cinder-74014 Jun 07 08:43:42.595580 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-323a78d3-004f-49bd-9a63-286c8039885c req-75085cee-8e5f-4c82-ac24-4ed1e81ea754 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034189 Jun 07 08:43:42.597070 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 317/645] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:43:42.618472 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-28ddd3a3-bc18-43d4-b60d-77ba0df16662 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbc17dea01a41ad9ca61bc65ed59cf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e49af480c6c4449b329b5e71904b17c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:42.627031 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-28ddd3a3-bc18-43d4-b60d-77ba0df16662 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 200 len: 1511 microversion: 2.1 time: 0.098892 Jun 07 08:43:42.627609 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 329/646] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:42 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 1511 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:43:43.646219 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-523bae6a-154b-4b65-8c5d-5d2312405185 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:43.646924 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-523bae6a-154b-4b65-8c5d-5d2312405185 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] [instance: b308a6f5-2c8d-45ad-ace4-9b623bfa76db] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:43.654054 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-523bae6a-154b-4b65-8c5d-5d2312405185 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:43.654513 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-523bae6a-154b-4b65-8c5d-5d2312405185 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:43.655547 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-523bae6a-154b-4b65-8c5d-5d2312405185 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:43.655991 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-523bae6a-154b-4b65-8c5d-5d2312405185 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:43.669283 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.wsgi [None req-523bae6a-154b-4b65-8c5d-5d2312405185 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] HTTP exception thrown: Instance b308a6f5-2c8d-45ad-ace4-9b623bfa76db could not be found. Jun 07 08:43:43.670920 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-523bae6a-154b-4b65-8c5d-5d2312405185 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Request method failure captured: Jun 07 08:43:43.670920 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: request: GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db HTTP/1.1 Jun 07 08:43:43.670920 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept: application/json Jun 07 08:43:43.670920 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept-Encoding: identity Jun 07 08:43:43.670920 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Connection: close Jun 07 08:43:43.670920 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Length: 0 Jun 07 08:43:43.670920 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Type: application/json Jun 07 08:43:43.670920 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Host: 10.222.0.17 Jun 07 08:43:43.670920 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Openstack-System-Scope: None Jun 07 08:43:43.670920 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: User-Agent: python-urllib3/1.26.9 Jun 07 08:43:43.670920 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Auth-Token: gAAAAABinw8eY8vQ9FmIMhgTOCCCYbXtxGu0fn8jRsiiBJZUTqsRuUI2BbMC1MZinRlXm22sdDHvOg8qZzOccFegDOxmybaKOM9VqZtpBx5rNSedlrfhv6hm--YO5uMSW_WKYUVlmwI4JMunryb4iAA3vwbSsS8UBZmjV-PE0kw0VQsmv9ez6c4 Jun 07 08:43:43.670920 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Id: None Jun 07 08:43:43.670920 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Name: None Jun 07 08:43:43.670920 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Identity-Status: Confirmed Jun 07 08:43:43.670920 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Is-Admin-Project: True Jun 07 08:43:43.670920 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Id: default Jun 07 08:43:43.670920 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Name: Default Jun 07 08:43:43.670920 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Id: 1e49af480c6c4449b329b5e71904b17c Jun 07 08:43:43.670920 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Name: tempest-TestMinimumBasicScenario-371020669 Jun 07 08:43:43.670920 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Role: reader,member Jun 07 08:43:43.670920 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Roles: reader,member Jun 07 08:43:43.674617 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1e49af480c6c4449b329b5e71904b17c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1e49af480c6c4449b329b5e71904b17c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1e49af480c6c4449b329b5e71904b17c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1e49af480c6c4449b329b5e71904b17c"}]}] Jun 07 08:43:43.674617 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant: tempest-TestMinimumBasicScenario-371020669 Jun 07 08:43:43.674617 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Id: 1e49af480c6c4449b329b5e71904b17c Jun 07 08:43:43.674617 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Name: tempest-TestMinimumBasicScenario-371020669 Jun 07 08:43:43.674617 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User: tempest-TestMinimumBasicScenario-371020669-project Jun 07 08:43:43.674617 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Id: default Jun 07 08:43:43.674617 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Name: Default Jun 07 08:43:43.674617 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Id: 3bbc17dea01a41ad9ca61bc65ed59cf6 Jun 07 08:43:43.674617 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Name: tempest-TestMinimumBasicScenario-371020669-project Jun 07 08:43:43.674617 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: method: > Jun 07 08:43:43.674617 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: exception: Instance b308a6f5-2c8d-45ad-ace4-9b623bfa76db could not be found. Jun 07 08:43:43.674617 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: action_args: {'id': 'b308a6f5-2c8d-45ad-ace4-9b623bfa76db'} Jun 07 08:43:43.675339 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:43:43.675339 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:43:43.675339 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:43:43.675339 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:43:43.675339 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:43:43.675339 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:43:43.675339 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:43:43.675339 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:43:43.675339 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:43:43.675339 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:43:43.675339 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b308a6f5-2c8d-45ad-ace4-9b623bfa76db could not be found. Jun 07 08:43:43.675339 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:43:43.675339 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:43:43.675339 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:43:43.675339 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:43:43.675339 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:43:43.675339 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:43:43.675339 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:43:43.675339 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:43:43.675339 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:43:43.676931 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:43:43.676931 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 08:43:43.676931 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 08:43:43.676931 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:43:43.676931 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:43:43.676931 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:43:43.676931 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:43:43.676931 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b308a6f5-2c8d-45ad-ace4-9b623bfa76db could not be found. Jun 07 08:43:43.676931 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:43:43.676931 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:43:43.676931 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:43:43.676931 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:43:43.676931 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:43:43.676931 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:43:43.676931 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:43:43.676931 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:43:43.676931 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b308a6f5-2c8d-45ad-ace4-9b623bfa76db could not be found. Jun 07 08:43:43.676931 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:43:43.678121 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-523bae6a-154b-4b65-8c5d-5d2312405185 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Returning 404 to user: Instance b308a6f5-2c8d-45ad-ace4-9b623bfa76db could not be found. {{(pid=129726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:43:43.678121 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-523bae6a-154b-4b65-8c5d-5d2312405185 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db" status: 404 len: 111 microversion: 2.1 time: 0.031352 Jun 07 08:43:43.678121 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 318/647] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:43:43 2022] GET /compute/v2.1/servers/b308a6f5-2c8d-45ad-ace4-9b623bfa76db => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:43:43.680984 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-e507cb66-f98d-40e1-b39e-89d81b10c962 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] Calling method '.version_select at 0x7f7fedccab80>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:43.736566 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-e507cb66-f98d-40e1-b39e-89d81b10c962 tempest-TestMinimumBasicScenario-371020669 tempest-TestMinimumBasicScenario-371020669-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-342018110" status: 202 len: 0 microversion: 2.1 time: 0.059160 Jun 07 08:43:43.737368 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 330/648] 10.222.0.17 () {58 vars in 1268 bytes} [Tue Jun 7 08:43:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-342018110 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 08:43:50.125444 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-ef5a7545-9186-49c0-ba6b-6b2b0e3a38ee tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:50.127049 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-ef5a7545-9186-49c0-ba6b-6b2b0e3a38ee tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:50.132154 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ef5a7545-9186-49c0-ba6b-6b2b0e3a38ee tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:50.132614 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ef5a7545-9186-49c0-ba6b-6b2b0e3a38ee tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:50.133420 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ef5a7545-9186-49c0-ba6b-6b2b0e3a38ee tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:50.134033 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ef5a7545-9186-49c0-ba6b-6b2b0e3a38ee tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:50.170829 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-ef5a7545-9186-49c0-ba6b-6b2b0e3a38ee tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200/ips" status: 200 len: 151 microversion: 2.20 time: 0.273111 Jun 07 08:43:50.171564 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 319/649] 10.222.0.17 () {60 vars in 1288 bytes} [Tue Jun 7 08:43:49 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200/ips => generated 151 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 07 08:43:54.368630 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=79 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:43:54.369482 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:43:54.374105 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-b92dfaf3-bd0a-4ebc-9c1c-a46b8918850b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:43:54.374627 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-b92dfaf3-bd0a-4ebc-9c1c-a46b8918850b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:54.380971 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b92dfaf3-bd0a-4ebc-9c1c-a46b8918850b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:54.381482 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b92dfaf3-bd0a-4ebc-9c1c-a46b8918850b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:54.382237 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b92dfaf3-bd0a-4ebc-9c1c-a46b8918850b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:54.382669 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b92dfaf3-bd0a-4ebc-9c1c-a46b8918850b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:54.412826 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.objects.instance [None req-b92dfaf3-bd0a-4ebc-9c1c-a46b8918850b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lazy-loading 'flavor' on Instance uuid bff05aff-3c16-4b84-b927-eaa3917a4200 {{(pid=129725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:43:54.996444 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-b92dfaf3-bd0a-4ebc-9c1c-a46b8918850b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "POST /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200/action" status: 202 len: 0 microversion: 2.20 time: 0.625467 Jun 07 08:43:54.996444 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 331/650] 10.222.0.17 () {62 vars in 1318 bytes} [Tue Jun 7 08:43:54 2022] POST /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200/action => generated 0 bytes in 627 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 08:43:55.001840 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-02a243bf-3784-4be5-8dd5-34b7f393c198 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:55.002484 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-02a243bf-3784-4be5-8dd5-34b7f393c198 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:55.008711 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-02a243bf-3784-4be5-8dd5-34b7f393c198 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:55.009202 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-02a243bf-3784-4be5-8dd5-34b7f393c198 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:55.009961 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-02a243bf-3784-4be5-8dd5-34b7f393c198 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:55.010400 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-02a243bf-3784-4be5-8dd5-34b7f393c198 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:55.150683 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-02a243bf-3784-4be5-8dd5-34b7f393c198 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:55.159816 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-02a243bf-3784-4be5-8dd5-34b7f393c198 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:55.161336 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-02a243bf-3784-4be5-8dd5-34b7f393c198 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:55.162522 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-02a243bf-3784-4be5-8dd5-34b7f393c198 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1723 microversion: 2.20 time: 0.164596 Jun 07 08:43:55.163263 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 320/651] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:43:54 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:43:56.182859 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-554c5c33-f8a5-4d97-8065-4928d0e4fb67 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:56.184208 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-554c5c33-f8a5-4d97-8065-4928d0e4fb67 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:56.190849 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-554c5c33-f8a5-4d97-8065-4928d0e4fb67 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:56.191303 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-554c5c33-f8a5-4d97-8065-4928d0e4fb67 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:56.192084 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-554c5c33-f8a5-4d97-8065-4928d0e4fb67 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:56.192524 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-554c5c33-f8a5-4d97-8065-4928d0e4fb67 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:56.332650 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-554c5c33-f8a5-4d97-8065-4928d0e4fb67 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:56.341976 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-554c5c33-f8a5-4d97-8065-4928d0e4fb67 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:56.343585 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-554c5c33-f8a5-4d97-8065-4928d0e4fb67 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:56.344748 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-554c5c33-f8a5-4d97-8065-4928d0e4fb67 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1723 microversion: 2.20 time: 0.166869 Jun 07 08:43:56.345333 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 332/652] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:43:56 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:43:57.364838 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-f263aded-dc3b-4d1e-bfc2-a1ca022d5e40 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:57.365522 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-f263aded-dc3b-4d1e-bfc2-a1ca022d5e40 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:57.372892 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f263aded-dc3b-4d1e-bfc2-a1ca022d5e40 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:57.373602 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f263aded-dc3b-4d1e-bfc2-a1ca022d5e40 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:57.374480 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f263aded-dc3b-4d1e-bfc2-a1ca022d5e40 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:57.375325 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f263aded-dc3b-4d1e-bfc2-a1ca022d5e40 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:57.644320 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-f263aded-dc3b-4d1e-bfc2-a1ca022d5e40 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:57.648554 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-f263aded-dc3b-4d1e-bfc2-a1ca022d5e40 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:57.650072 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-f263aded-dc3b-4d1e-bfc2-a1ca022d5e40 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:57.651218 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-f263aded-dc3b-4d1e-bfc2-a1ca022d5e40 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1723 microversion: 2.20 time: 0.290362 Jun 07 08:43:57.651772 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 321/653] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:43:57 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:43:58.670862 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-a7ab32ba-943b-4d93-9447-32e39c281a20 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:58.671571 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-a7ab32ba-943b-4d93-9447-32e39c281a20 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:58.679158 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a7ab32ba-943b-4d93-9447-32e39c281a20 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:58.679861 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a7ab32ba-943b-4d93-9447-32e39c281a20 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:58.680927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a7ab32ba-943b-4d93-9447-32e39c281a20 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:58.681403 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a7ab32ba-943b-4d93-9447-32e39c281a20 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:58.821861 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-a7ab32ba-943b-4d93-9447-32e39c281a20 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:58.830569 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-a7ab32ba-943b-4d93-9447-32e39c281a20 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:58.832077 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-a7ab32ba-943b-4d93-9447-32e39c281a20 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:43:58.833525 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-a7ab32ba-943b-4d93-9447-32e39c281a20 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1723 microversion: 2.20 time: 0.166755 Jun 07 08:43:58.834433 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 333/654] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:43:58 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:43:59.852371 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-87f6dc8b-601c-4afb-9a89-b65979a4b5d0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:43:59.857665 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-87f6dc8b-601c-4afb-9a89-b65979a4b5d0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:43:59.865427 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-87f6dc8b-601c-4afb-9a89-b65979a4b5d0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:59.865874 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-87f6dc8b-601c-4afb-9a89-b65979a4b5d0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:43:59.866826 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-87f6dc8b-601c-4afb-9a89-b65979a4b5d0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:43:59.867247 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-87f6dc8b-601c-4afb-9a89-b65979a4b5d0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:00.144268 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-87f6dc8b-601c-4afb-9a89-b65979a4b5d0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:00.154778 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-87f6dc8b-601c-4afb-9a89-b65979a4b5d0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:00.156560 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-87f6dc8b-601c-4afb-9a89-b65979a4b5d0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:00.157763 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-87f6dc8b-601c-4afb-9a89-b65979a4b5d0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1723 microversion: 2.20 time: 0.309569 Jun 07 08:44:00.159392 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 322/655] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:43:59 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1723 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:01.175579 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-8cdb864b-f611-4404-ac72-474abd9b0123 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:01.176915 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-8cdb864b-f611-4404-ac72-474abd9b0123 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:01.184520 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8cdb864b-f611-4404-ac72-474abd9b0123 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:01.184969 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8cdb864b-f611-4404-ac72-474abd9b0123 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:01.185754 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8cdb864b-f611-4404-ac72-474abd9b0123 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:01.186188 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8cdb864b-f611-4404-ac72-474abd9b0123 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:01.329504 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-8cdb864b-f611-4404-ac72-474abd9b0123 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:01.337053 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-8cdb864b-f611-4404-ac72-474abd9b0123 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:01.338540 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-8cdb864b-f611-4404-ac72-474abd9b0123 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:01.339680 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-8cdb864b-f611-4404-ac72-474abd9b0123 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1723 microversion: 2.20 time: 0.168004 Jun 07 08:44:01.340787 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 334/656] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:01 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:02.358608 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-f167c01b-e720-4db2-8eff-1baaea2ed5d2 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:02.361039 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-f167c01b-e720-4db2-8eff-1baaea2ed5d2 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:02.368419 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f167c01b-e720-4db2-8eff-1baaea2ed5d2 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:02.369253 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f167c01b-e720-4db2-8eff-1baaea2ed5d2 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:02.370262 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f167c01b-e720-4db2-8eff-1baaea2ed5d2 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:02.370704 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f167c01b-e720-4db2-8eff-1baaea2ed5d2 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:02.550972 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-f167c01b-e720-4db2-8eff-1baaea2ed5d2 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:02.559311 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-f167c01b-e720-4db2-8eff-1baaea2ed5d2 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:02.560865 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-f167c01b-e720-4db2-8eff-1baaea2ed5d2 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:02.562061 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-f167c01b-e720-4db2-8eff-1baaea2ed5d2 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1723 microversion: 2.20 time: 0.207523 Jun 07 08:44:02.562821 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 323/657] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:02 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:03.584080 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-581002a5-912c-4913-ac01-b7ac1d91382a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:03.584508 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-581002a5-912c-4913-ac01-b7ac1d91382a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:03.597259 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-581002a5-912c-4913-ac01-b7ac1d91382a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:03.597712 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-581002a5-912c-4913-ac01-b7ac1d91382a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:03.598548 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-581002a5-912c-4913-ac01-b7ac1d91382a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:03.598988 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-581002a5-912c-4913-ac01-b7ac1d91382a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:03.823041 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-581002a5-912c-4913-ac01-b7ac1d91382a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:03.838053 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-581002a5-912c-4913-ac01-b7ac1d91382a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:03.841672 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-581002a5-912c-4913-ac01-b7ac1d91382a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:03.844123 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-581002a5-912c-4913-ac01-b7ac1d91382a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1723 microversion: 2.20 time: 0.267592 Jun 07 08:44:03.844775 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 335/658] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:03 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:04.862679 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-6ca11439-6c6e-4453-bd07-d526f8469bdb tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:04.863347 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-6ca11439-6c6e-4453-bd07-d526f8469bdb tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:04.870198 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6ca11439-6c6e-4453-bd07-d526f8469bdb tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:04.871135 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6ca11439-6c6e-4453-bd07-d526f8469bdb tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:04.872098 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6ca11439-6c6e-4453-bd07-d526f8469bdb tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:04.872741 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6ca11439-6c6e-4453-bd07-d526f8469bdb tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:05.035785 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-6ca11439-6c6e-4453-bd07-d526f8469bdb tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:05.045374 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-6ca11439-6c6e-4453-bd07-d526f8469bdb tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:05.046793 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-6ca11439-6c6e-4453-bd07-d526f8469bdb tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:05.047976 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-6ca11439-6c6e-4453-bd07-d526f8469bdb tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1723 microversion: 2.20 time: 0.189638 Jun 07 08:44:05.048539 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 324/659] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:04 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:06.066530 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-5ae2661d-ee9c-499f-8e73-83c7f5030ead tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:06.068218 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-5ae2661d-ee9c-499f-8e73-83c7f5030ead tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:06.076039 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5ae2661d-ee9c-499f-8e73-83c7f5030ead tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:06.076669 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5ae2661d-ee9c-499f-8e73-83c7f5030ead tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:06.081109 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5ae2661d-ee9c-499f-8e73-83c7f5030ead tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:06.081109 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5ae2661d-ee9c-499f-8e73-83c7f5030ead tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:06.321856 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-5ae2661d-ee9c-499f-8e73-83c7f5030ead tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:06.330303 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-5ae2661d-ee9c-499f-8e73-83c7f5030ead tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:06.331832 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-5ae2661d-ee9c-499f-8e73-83c7f5030ead tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:06.333097 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-5ae2661d-ee9c-499f-8e73-83c7f5030ead tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1723 microversion: 2.20 time: 0.270334 Jun 07 08:44:06.343331 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 336/660] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:06 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:07.359774 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-55bb4de9-292a-4b99-ae79-a2cf36b0be15 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:07.360296 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-55bb4de9-292a-4b99-ae79-a2cf36b0be15 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:07.366685 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-55bb4de9-292a-4b99-ae79-a2cf36b0be15 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:07.367133 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-55bb4de9-292a-4b99-ae79-a2cf36b0be15 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:07.367898 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-55bb4de9-292a-4b99-ae79-a2cf36b0be15 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:07.368335 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-55bb4de9-292a-4b99-ae79-a2cf36b0be15 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:07.492345 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-c1c25c8d-5318-48f4-b622-be7fff565995 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Action: 'create', calling method: .version_select at 0x7f7feca8cee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1080759724", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsRKZUsL2Vk+4/QHI2AxOVnv2AKj9yp5/pwKc3vGMRmG3G3M+lxtdmgj3/SmxgFErYMU6KYplU8xnkzPfDm/jaUMIKP8ZIZ8bVDTaIaQsilXJzdmv2zALgnSEPFQbI96A=="}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:44:07.507055 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-c1c25c8d-5318-48f4-b622-be7fff565995 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Getting quotas for project bfc85651f1d947e3b52f02b4cf8e26b3. Resources: {'key_pairs'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 08:44:07.511399 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-c1c25c8d-5318-48f4-b622-be7fff565995 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Getting quotas for user 346ec431db3947ea97f1f2e3b27db0a0 and project bfc85651f1d947e3b52f02b4cf8e26b3. Resources: {'key_pairs'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 08:44:07.516850 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-55bb4de9-292a-4b99-ae79-a2cf36b0be15 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:07.524891 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-55bb4de9-292a-4b99-ae79-a2cf36b0be15 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:07.526547 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-55bb4de9-292a-4b99-ae79-a2cf36b0be15 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:07.527820 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-55bb4de9-292a-4b99-ae79-a2cf36b0be15 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1723 microversion: 2.20 time: 0.172628 Jun 07 08:44:07.528482 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 337/661] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:07 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:44:07.604750 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-c1c25c8d-5318-48f4-b622-be7fff565995 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.286791 Jun 07 08:44:07.605913 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 325/662] 10.222.0.17 () {60 vars in 1158 bytes} [Tue Jun 7 08:44:07 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:44:08.550145 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-11425f1b-3851-4c5c-9a37-8995016d055a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:08.551430 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-11425f1b-3851-4c5c-9a37-8995016d055a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:08.557813 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-11425f1b-3851-4c5c-9a37-8995016d055a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:08.558273 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-11425f1b-3851-4c5c-9a37-8995016d055a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:08.559169 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-11425f1b-3851-4c5c-9a37-8995016d055a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:08.559610 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-11425f1b-3851-4c5c-9a37-8995016d055a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:08.706983 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-11425f1b-3851-4c5c-9a37-8995016d055a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:08.721230 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-11425f1b-3851-4c5c-9a37-8995016d055a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:08.723142 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-11425f1b-3851-4c5c-9a37-8995016d055a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:08.724745 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-11425f1b-3851-4c5c-9a37-8995016d055a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1723 microversion: 2.20 time: 0.178545 Jun 07 08:44:08.736132 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 338/663] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:08 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:09.744309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-9ca7da91-9bef-444b-9178-636fadf0214b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:09.744928 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-9ca7da91-9bef-444b-9178-636fadf0214b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:09.751894 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9ca7da91-9bef-444b-9178-636fadf0214b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:09.752532 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9ca7da91-9bef-444b-9178-636fadf0214b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:09.753420 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9ca7da91-9bef-444b-9178-636fadf0214b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:09.753863 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9ca7da91-9bef-444b-9178-636fadf0214b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:09.756908 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:44:09.938990 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-9ca7da91-9bef-444b-9178-636fadf0214b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:09.947926 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-9ca7da91-9bef-444b-9178-636fadf0214b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:09.949725 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-9ca7da91-9bef-444b-9178-636fadf0214b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:09.951238 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-9ca7da91-9bef-444b-9178-636fadf0214b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1723 microversion: 2.20 time: 0.211439 Jun 07 08:44:09.952356 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 326/664] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:09 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:10.968597 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-1724c3e0-cef7-4247-b539-689f9f79449e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:10.969253 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-1724c3e0-cef7-4247-b539-689f9f79449e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:10.975736 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1724c3e0-cef7-4247-b539-689f9f79449e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:10.981679 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1724c3e0-cef7-4247-b539-689f9f79449e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:10.981679 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1724c3e0-cef7-4247-b539-689f9f79449e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:10.981679 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1724c3e0-cef7-4247-b539-689f9f79449e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:11.112229 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-1724c3e0-cef7-4247-b539-689f9f79449e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:11.120212 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-1724c3e0-cef7-4247-b539-689f9f79449e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:11.122244 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-1724c3e0-cef7-4247-b539-689f9f79449e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:11.123461 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-1724c3e0-cef7-4247-b539-689f9f79449e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1723 microversion: 2.20 time: 0.158829 Jun 07 08:44:11.124012 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 339/665] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:10 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:12.142538 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-3edcd3cd-0132-41b0-b373-b4a05caf21ea tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:12.143148 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-3edcd3cd-0132-41b0-b373-b4a05caf21ea tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:12.150388 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3edcd3cd-0132-41b0-b373-b4a05caf21ea tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:12.150837 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3edcd3cd-0132-41b0-b373-b4a05caf21ea tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:12.151594 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3edcd3cd-0132-41b0-b373-b4a05caf21ea tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:12.152065 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3edcd3cd-0132-41b0-b373-b4a05caf21ea tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:12.294372 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-3edcd3cd-0132-41b0-b373-b4a05caf21ea tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:12.302420 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-3edcd3cd-0132-41b0-b373-b4a05caf21ea tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:12.303990 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-3edcd3cd-0132-41b0-b373-b4a05caf21ea tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:12.305134 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-3edcd3cd-0132-41b0-b373-b4a05caf21ea tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1723 microversion: 2.20 time: 0.166440 Jun 07 08:44:12.305706 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 327/666] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:12 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:13.323174 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-11f97acc-338d-43d9-adb6-a814dea6cbe8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:13.323846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-11f97acc-338d-43d9-adb6-a814dea6cbe8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:13.331169 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-11f97acc-338d-43d9-adb6-a814dea6cbe8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:13.331621 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-11f97acc-338d-43d9-adb6-a814dea6cbe8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:13.332392 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-11f97acc-338d-43d9-adb6-a814dea6cbe8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:13.332873 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-11f97acc-338d-43d9-adb6-a814dea6cbe8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:13.467177 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-11f97acc-338d-43d9-adb6-a814dea6cbe8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:13.475284 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-11f97acc-338d-43d9-adb6-a814dea6cbe8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:13.476762 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-11f97acc-338d-43d9-adb6-a814dea6cbe8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:13.477935 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-11f97acc-338d-43d9-adb6-a814dea6cbe8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1723 microversion: 2.20 time: 0.158872 Jun 07 08:44:13.478511 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 340/667] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:13 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:14.496910 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-44be4932-5ef4-431d-ad1a-5352b6c6b36e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:14.497553 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-44be4932-5ef4-431d-ad1a-5352b6c6b36e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:14.499969 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:44:14.505226 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-44be4932-5ef4-431d-ad1a-5352b6c6b36e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:14.505733 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-44be4932-5ef4-431d-ad1a-5352b6c6b36e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:14.506618 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-44be4932-5ef4-431d-ad1a-5352b6c6b36e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:14.507080 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-44be4932-5ef4-431d-ad1a-5352b6c6b36e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:14.643797 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-44be4932-5ef4-431d-ad1a-5352b6c6b36e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:14.652119 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-44be4932-5ef4-431d-ad1a-5352b6c6b36e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:14.653392 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-44be4932-5ef4-431d-ad1a-5352b6c6b36e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:14.654595 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-44be4932-5ef4-431d-ad1a-5352b6c6b36e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1723 microversion: 2.20 time: 0.162177 Jun 07 08:44:14.655423 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 328/668] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:14 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:15.672848 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-c6914c0b-9cc9-4e85-ad6d-aae22db190ad tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:15.673475 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-c6914c0b-9cc9-4e85-ad6d-aae22db190ad tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:15.680247 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c6914c0b-9cc9-4e85-ad6d-aae22db190ad tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:15.680737 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c6914c0b-9cc9-4e85-ad6d-aae22db190ad tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:15.681697 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c6914c0b-9cc9-4e85-ad6d-aae22db190ad tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:15.682038 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c6914c0b-9cc9-4e85-ad6d-aae22db190ad tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:15.820924 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-c6914c0b-9cc9-4e85-ad6d-aae22db190ad tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:15.830061 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-c6914c0b-9cc9-4e85-ad6d-aae22db190ad tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:15.831568 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-c6914c0b-9cc9-4e85-ad6d-aae22db190ad tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:15.832737 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-c6914c0b-9cc9-4e85-ad6d-aae22db190ad tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1744 microversion: 2.20 time: 0.163702 Jun 07 08:44:15.833365 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 341/669] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:15 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:16.852025 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-3c7d1d7b-63fd-4dfc-a973-203ed065701e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:16.852896 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-3c7d1d7b-63fd-4dfc-a973-203ed065701e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:16.859994 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3c7d1d7b-63fd-4dfc-a973-203ed065701e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:16.860523 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3c7d1d7b-63fd-4dfc-a973-203ed065701e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:16.861398 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3c7d1d7b-63fd-4dfc-a973-203ed065701e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:16.861906 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3c7d1d7b-63fd-4dfc-a973-203ed065701e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:16.993468 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-3c7d1d7b-63fd-4dfc-a973-203ed065701e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:17.001388 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-3c7d1d7b-63fd-4dfc-a973-203ed065701e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:17.002876 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-3c7d1d7b-63fd-4dfc-a973-203ed065701e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:17.004009 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-3c7d1d7b-63fd-4dfc-a973-203ed065701e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1744 microversion: 2.20 time: 0.155947 Jun 07 08:44:17.004564 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 329/670] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:16 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:18.022376 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-1ac7b81b-0b7c-406e-9963-58c208fbf2f0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:18.022990 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-1ac7b81b-0b7c-406e-9963-58c208fbf2f0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:18.030578 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1ac7b81b-0b7c-406e-9963-58c208fbf2f0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:18.031029 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1ac7b81b-0b7c-406e-9963-58c208fbf2f0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:18.031806 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1ac7b81b-0b7c-406e-9963-58c208fbf2f0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:18.032244 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1ac7b81b-0b7c-406e-9963-58c208fbf2f0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:18.182473 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-1ac7b81b-0b7c-406e-9963-58c208fbf2f0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:18.191196 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-1ac7b81b-0b7c-406e-9963-58c208fbf2f0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:18.192690 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-1ac7b81b-0b7c-406e-9963-58c208fbf2f0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:18.193883 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-1ac7b81b-0b7c-406e-9963-58c208fbf2f0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1739 microversion: 2.20 time: 0.175450 Jun 07 08:44:18.194444 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 342/671] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:18 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:19.219271 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-b386d9d4-d0d1-48ac-bf80-c6807de6b006 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:19.220535 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-b386d9d4-d0d1-48ac-bf80-c6807de6b006 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:19.222736 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell0:SELECT=4 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:44:19.229750 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b386d9d4-d0d1-48ac-bf80-c6807de6b006 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:19.230487 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b386d9d4-d0d1-48ac-bf80-c6807de6b006 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:19.231464 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b386d9d4-d0d1-48ac-bf80-c6807de6b006 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:19.232071 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b386d9d4-d0d1-48ac-bf80-c6807de6b006 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:19.422861 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-b386d9d4-d0d1-48ac-bf80-c6807de6b006 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:19.441334 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-b386d9d4-d0d1-48ac-bf80-c6807de6b006 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:19.446966 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-b386d9d4-d0d1-48ac-bf80-c6807de6b006 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:19.448762 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-b386d9d4-d0d1-48ac-bf80-c6807de6b006 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1739 microversion: 2.20 time: 0.234521 Jun 07 08:44:19.453128 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 330/672] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:19 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1739 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:44:19.741708 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-a9593ef6-65e5-445f-9c0b-ba7aa020a167 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:19.742470 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-a9593ef6-65e5-445f-9c0b-ba7aa020a167 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:19.749855 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a9593ef6-65e5-445f-9c0b-ba7aa020a167 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:19.750774 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a9593ef6-65e5-445f-9c0b-ba7aa020a167 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:19.751730 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a9593ef6-65e5-445f-9c0b-ba7aa020a167 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:19.752375 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a9593ef6-65e5-445f-9c0b-ba7aa020a167 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:19.800400 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-a9593ef6-65e5-445f-9c0b-ba7aa020a167 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971/ips" status: 200 len: 145 microversion: 2.1 time: 0.062438 Jun 07 08:44:19.802652 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 331/673] 10.222.0.17 () {58 vars in 1247 bytes} [Tue Jun 7 08:44:19 2022] GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971/ips => generated 145 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:44:19.898055 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-77cf3af7-751a-472f-85b9-599303d12d5f req-e3a1d380-a84c-422b-9f6f-a5cb191be371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bff05aff-3c16-4b84-b927-eaa3917a4200", "name": "network-vif-plugged", "status": "completed", "tag": "ac5f8c52-180a-42f4-8102-9668d2229d61"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:44:19.909084 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-77cf3af7-751a-472f-85b9-599303d12d5f req-e3a1d380-a84c-422b-9f6f-a5cb191be371 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:19.909806 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-77cf3af7-751a-472f-85b9-599303d12d5f req-e3a1d380-a84c-422b-9f6f-a5cb191be371 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:19.922938 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-77cf3af7-751a-472f-85b9-599303d12d5f req-e3a1d380-a84c-422b-9f6f-a5cb191be371 service nova] Creating event network-vif-plugged:ac5f8c52-180a-42f4-8102-9668d2229d61 for instance bff05aff-3c16-4b84-b927-eaa3917a4200 on hv-cinder-74014 Jun 07 08:44:19.930989 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-77cf3af7-751a-472f-85b9-599303d12d5f req-e3a1d380-a84c-422b-9f6f-a5cb191be371 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.285239 Jun 07 08:44:19.935360 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 343/674] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:44:20.474951 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-e7b6cf17-9480-4f5f-8565-a01e04cc170e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:20.476886 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-e7b6cf17-9480-4f5f-8565-a01e04cc170e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:20.483501 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e7b6cf17-9480-4f5f-8565-a01e04cc170e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:20.484141 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e7b6cf17-9480-4f5f-8565-a01e04cc170e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:20.485109 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e7b6cf17-9480-4f5f-8565-a01e04cc170e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:20.485700 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e7b6cf17-9480-4f5f-8565-a01e04cc170e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:20.641940 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-e7b6cf17-9480-4f5f-8565-a01e04cc170e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:20.651259 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-e7b6cf17-9480-4f5f-8565-a01e04cc170e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:20.652839 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-e7b6cf17-9480-4f5f-8565-a01e04cc170e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:20.654221 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-e7b6cf17-9480-4f5f-8565-a01e04cc170e tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1739 microversion: 2.20 time: 0.183664 Jun 07 08:44:20.655225 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 332/675] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:20 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:21.606099 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-a1620419-0ca2-498d-a235-c01235c44ec2 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ecc8ac5-df10-4ef5-9753-4767ecf3c7b9"}} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:44:21.608461 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-a1620419-0ca2-498d-a235-c01235c44ec2 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:21.615731 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a1620419-0ca2-498d-a235-c01235c44ec2 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:21.616579 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a1620419-0ca2-498d-a235-c01235c44ec2 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:21.618261 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a1620419-0ca2-498d-a235-c01235c44ec2 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:21.618935 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a1620419-0ca2-498d-a235-c01235c44ec2 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:21.678125 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-c3700ef4-fc95-4749-9c42-8d5e39f91856 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:21.678875 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-c3700ef4-fc95-4749-9c42-8d5e39f91856 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:21.686529 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c3700ef4-fc95-4749-9c42-8d5e39f91856 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:21.687115 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c3700ef4-fc95-4749-9c42-8d5e39f91856 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:21.688095 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c3700ef4-fc95-4749-9c42-8d5e39f91856 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:21.688637 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c3700ef4-fc95-4749-9c42-8d5e39f91856 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:21.887757 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-c3700ef4-fc95-4749-9c42-8d5e39f91856 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:21.896757 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-c3700ef4-fc95-4749-9c42-8d5e39f91856 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:21.898543 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-c3700ef4-fc95-4749-9c42-8d5e39f91856 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:21.899748 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-c3700ef4-fc95-4749-9c42-8d5e39f91856 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1739 microversion: 2.20 time: 0.225457 Jun 07 08:44:21.900323 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 333/676] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:21 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:44:22.679517 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:44:22.827311 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-a1620419-0ca2-498d-a235-c01235c44ec2 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "POST /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.226297 Jun 07 08:44:22.827931 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 344/677] 10.222.0.17 () {60 vars in 1322 bytes} [Tue Jun 7 08:44:21 2022] POST /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971/os-volume_attachments => generated 194 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:44:22.921770 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-96ce3aec-9889-45df-a8cb-da93a32bf242 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:22.922376 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-96ce3aec-9889-45df-a8cb-da93a32bf242 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:22.930846 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-96ce3aec-9889-45df-a8cb-da93a32bf242 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:22.931306 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-96ce3aec-9889-45df-a8cb-da93a32bf242 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:22.932071 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-96ce3aec-9889-45df-a8cb-da93a32bf242 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:22.932503 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-96ce3aec-9889-45df-a8cb-da93a32bf242 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:23.160224 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-96ce3aec-9889-45df-a8cb-da93a32bf242 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:23.169389 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-96ce3aec-9889-45df-a8cb-da93a32bf242 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:23.173680 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-96ce3aec-9889-45df-a8cb-da93a32bf242 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:23.175094 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-96ce3aec-9889-45df-a8cb-da93a32bf242 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1739 microversion: 2.20 time: 0.257314 Jun 07 08:44:23.176137 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 334/678] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:22 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1739 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:24.200027 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-35359bb8-2a38-406d-bca5-43779ee1251f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:24.200882 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-35359bb8-2a38-406d-bca5-43779ee1251f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:24.208726 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-35359bb8-2a38-406d-bca5-43779ee1251f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:24.209421 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-35359bb8-2a38-406d-bca5-43779ee1251f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:24.210382 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-35359bb8-2a38-406d-bca5-43779ee1251f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:24.211036 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-35359bb8-2a38-406d-bca5-43779ee1251f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:24.374850 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-35359bb8-2a38-406d-bca5-43779ee1251f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:24.384358 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-35359bb8-2a38-406d-bca5-43779ee1251f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:24.386945 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-35359bb8-2a38-406d-bca5-43779ee1251f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:24.388278 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-35359bb8-2a38-406d-bca5-43779ee1251f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1739 microversion: 2.20 time: 0.194193 Jun 07 08:44:24.389195 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 345/679] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:24 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:25.416072 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-a09be134-8fce-49e2-9c38-cc1d7fd583d7 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:25.416696 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-a09be134-8fce-49e2-9c38-cc1d7fd583d7 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:25.423246 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a09be134-8fce-49e2-9c38-cc1d7fd583d7 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:25.423704 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a09be134-8fce-49e2-9c38-cc1d7fd583d7 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:25.424471 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a09be134-8fce-49e2-9c38-cc1d7fd583d7 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:25.424926 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a09be134-8fce-49e2-9c38-cc1d7fd583d7 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:25.559064 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-a09be134-8fce-49e2-9c38-cc1d7fd583d7 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:25.567427 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-a09be134-8fce-49e2-9c38-cc1d7fd583d7 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:25.588636 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-a09be134-8fce-49e2-9c38-cc1d7fd583d7 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:25.588636 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-a09be134-8fce-49e2-9c38-cc1d7fd583d7 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1739 microversion: 2.20 time: 0.158206 Jun 07 08:44:25.588636 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 335/680] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:25 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:26.590563 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-50d15c00-0f05-4bb8-8f97-9cf34a5f510c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:26.591172 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-50d15c00-0f05-4bb8-8f97-9cf34a5f510c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:26.593632 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_api:SELECT=31 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:44:26.598463 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-50d15c00-0f05-4bb8-8f97-9cf34a5f510c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:26.598915 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-50d15c00-0f05-4bb8-8f97-9cf34a5f510c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:26.599683 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-50d15c00-0f05-4bb8-8f97-9cf34a5f510c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:26.600200 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-50d15c00-0f05-4bb8-8f97-9cf34a5f510c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:26.736337 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-50d15c00-0f05-4bb8-8f97-9cf34a5f510c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:26.746880 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-50d15c00-0f05-4bb8-8f97-9cf34a5f510c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:26.748736 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-50d15c00-0f05-4bb8-8f97-9cf34a5f510c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:26.750449 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-50d15c00-0f05-4bb8-8f97-9cf34a5f510c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1739 microversion: 2.20 time: 0.163944 Jun 07 08:44:26.751527 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 346/681] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:26 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:27.771543 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-4d0376ca-c64c-4e83-b437-9f5624a80fd0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:27.772096 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-4d0376ca-c64c-4e83-b437-9f5624a80fd0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:27.778709 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4d0376ca-c64c-4e83-b437-9f5624a80fd0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:27.780009 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4d0376ca-c64c-4e83-b437-9f5624a80fd0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:27.782494 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4d0376ca-c64c-4e83-b437-9f5624a80fd0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:27.784103 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4d0376ca-c64c-4e83-b437-9f5624a80fd0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:28.006621 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-4d0376ca-c64c-4e83-b437-9f5624a80fd0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:28.016919 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-4d0376ca-c64c-4e83-b437-9f5624a80fd0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:28.020435 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-4d0376ca-c64c-4e83-b437-9f5624a80fd0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:28.022291 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-4d0376ca-c64c-4e83-b437-9f5624a80fd0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1739 microversion: 2.20 time: 0.254877 Jun 07 08:44:28.023230 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 336/682] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:27 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1739 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:28.033458 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-bb5d843a-2fae-4b10-a8fd-a4b14865e32f tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2047925337", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1080759724", "security_groups": [{"name": "tempest-secgroup-smoke-143125829"}], "networks": [{"uuid": "d4542aa1-e643-4f39-ab69-55e23284b91c"}], "block_device_mapping_v2": [{"uuid": "9265eabb-20b9-476b-a868-e2eb30e9ace5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:44:28.175298 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.network.neutron [None req-bb5d843a-2fae-4b10-a8fd-a4b14865e32f tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] validate_networks() for [('d4542aa1-e643-4f39-ab69-55e23284b91c', None, None, None, None, None)] {{(pid=129725) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 08:44:28.794366 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-bb5d843a-2fae-4b10-a8fd-a4b14865e32f tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Flavor limits 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 08:44:28.794803 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-bb5d843a-2fae-4b10-a8fd-a4b14865e32f tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Image limits 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 08:44:28.795263 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-bb5d843a-2fae-4b10-a8fd-a4b14865e32f tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Flavor pref 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 08:44:28.795677 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-bb5d843a-2fae-4b10-a8fd-a4b14865e32f tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Image pref 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 08:44:28.796091 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-bb5d843a-2fae-4b10-a8fd-a4b14865e32f tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 08:44:28.806382 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-bb5d843a-2fae-4b10-a8fd-a4b14865e32f tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:28.806835 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-bb5d843a-2fae-4b10-a8fd-a4b14865e32f tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:28.810839 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-bb5d843a-2fae-4b10-a8fd-a4b14865e32f tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:28.810839 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-bb5d843a-2fae-4b10-a8fd-a4b14865e32f tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:28.827267 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.quota [None req-bb5d843a-2fae-4b10-a8fd-a4b14865e32f tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Getting quotas for project bfc85651f1d947e3b52f02b4cf8e26b3. Resources: {'ram', 'cores', 'instances'} {{(pid=129725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 08:44:28.831997 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.quota [None req-bb5d843a-2fae-4b10-a8fd-a4b14865e32f tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Getting quotas for user 346ec431db3947ea97f1f2e3b27db0a0 and project bfc85651f1d947e3b52f02b4cf8e26b3. Resources: {'ram', 'cores', 'instances'} {{(pid=129725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 08:44:28.905705 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-bb5d843a-2fae-4b10-a8fd-a4b14865e32f tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Going to run 1 instances... {{(pid=129725) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 08:44:28.907835 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-bb5d843a-2fae-4b10-a8fd-a4b14865e32f tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9265eabb-20b9-476b-a868-e2eb30e9ace5',volume_size=None,volume_type=None)] {{(pid=129725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 08:44:29.042750 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-a2d81da3-a13d-412d-a300-53d4e91bf0e5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:29.043440 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-a2d81da3-a13d-412d-a300-53d4e91bf0e5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:29.050092 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a2d81da3-a13d-412d-a300-53d4e91bf0e5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:29.050554 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a2d81da3-a13d-412d-a300-53d4e91bf0e5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:29.051318 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a2d81da3-a13d-412d-a300-53d4e91bf0e5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:29.051748 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a2d81da3-a13d-412d-a300-53d4e91bf0e5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:29.192137 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-a2d81da3-a13d-412d-a300-53d4e91bf0e5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:29.203339 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-a2d81da3-a13d-412d-a300-53d4e91bf0e5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:29.204888 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-a2d81da3-a13d-412d-a300-53d4e91bf0e5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:29.206274 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-a2d81da3-a13d-412d-a300-53d4e91bf0e5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1739 microversion: 2.20 time: 0.167361 Jun 07 08:44:29.206867 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 337/683] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:29 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:44:29.793986 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-bb5d843a-2fae-4b10-a8fd-a4b14865e32f tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.765043 Jun 07 08:44:29.795693 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 347/684] 10.222.0.17 () {60 vars in 1146 bytes} [Tue Jun 7 08:44:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 1768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 08:44:29.805693 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-c72fc8f4-41af-4758-bc5e-4a9290a33e2e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:29.807389 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-c72fc8f4-41af-4758-bc5e-4a9290a33e2e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:29.876750 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-c72fc8f4-41af-4758-bc5e-4a9290a33e2e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:29.889387 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-c72fc8f4-41af-4758-bc5e-4a9290a33e2e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1089 microversion: 2.1 time: 0.087351 Jun 07 08:44:29.889829 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 338/685] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:44:29 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1089 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:44:30.225996 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-39e45436-9dc6-46f4-ab66-3bf02a61078a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:30.226842 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-39e45436-9dc6-46f4-ab66-3bf02a61078a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:30.236158 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-39e45436-9dc6-46f4-ab66-3bf02a61078a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:30.236613 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-39e45436-9dc6-46f4-ab66-3bf02a61078a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:30.237415 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-39e45436-9dc6-46f4-ab66-3bf02a61078a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:30.238360 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-39e45436-9dc6-46f4-ab66-3bf02a61078a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:30.423637 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-39e45436-9dc6-46f4-ab66-3bf02a61078a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:30.436114 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-39e45436-9dc6-46f4-ab66-3bf02a61078a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:30.436114 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-39e45436-9dc6-46f4-ab66-3bf02a61078a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:30.436114 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-39e45436-9dc6-46f4-ab66-3bf02a61078a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1739 microversion: 2.20 time: 0.213974 Jun 07 08:44:30.437124 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 348/686] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:30 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1739 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:30.606532 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-b9f68834-2618-45fc-909c-d0a023db9314 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:30.610639 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-b9f68834-2618-45fc-909c-d0a023db9314 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:30.617599 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b9f68834-2618-45fc-909c-d0a023db9314 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:30.634106 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b9f68834-2618-45fc-909c-d0a023db9314 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:30.635235 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b9f68834-2618-45fc-909c-d0a023db9314 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:30.635906 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b9f68834-2618-45fc-909c-d0a023db9314 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:30.680939 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-b9f68834-2618-45fc-909c-d0a023db9314 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079036 Jun 07 08:44:30.681846 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 339/687] 10.222.0.17 () {58 vars in 1301 bytes} [Tue Jun 7 08:44:30 2022] GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:44:30.691274 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-bb6b132c-3783-4f81-a02e-caa81044da8e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:30.691771 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-bb6b132c-3783-4f81-a02e-caa81044da8e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:30.697807 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-bb6b132c-3783-4f81-a02e-caa81044da8e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:30.702301 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-bb6b132c-3783-4f81-a02e-caa81044da8e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:30.702301 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-bb6b132c-3783-4f81-a02e-caa81044da8e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:30.702301 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-bb6b132c-3783-4f81-a02e-caa81044da8e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:30.731479 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-bb6b132c-3783-4f81-a02e-caa81044da8e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971/os-volume_attachments/5ecc8ac5-df10-4ef5-9753-4767ecf3c7b9" status: 200 len: 194 microversion: 2.1 time: 0.043416 Jun 07 08:44:30.732373 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 349/688] 10.222.0.17 () {58 vars in 1412 bytes} [Tue Jun 7 08:44:30 2022] GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971/os-volume_attachments/5ecc8ac5-df10-4ef5-9753-4767ecf3c7b9 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:44:30.907185 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-76b109bd-2148-4b98-9063-d0f06ff337cb tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:30.907901 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-76b109bd-2148-4b98-9063-d0f06ff337cb tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:30.963856 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-76b109bd-2148-4b98-9063-d0f06ff337cb tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:30.979325 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-76b109bd-2148-4b98-9063-d0f06ff337cb tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1089 microversion: 2.1 time: 0.073663 Jun 07 08:44:30.979325 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 340/689] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:44:30 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1089 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:44:31.459339 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-9cd5a685-096e-4f93-b378-38f19c57a684 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:31.459339 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-9cd5a685-096e-4f93-b378-38f19c57a684 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:31.464986 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9cd5a685-096e-4f93-b378-38f19c57a684 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:31.465467 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9cd5a685-096e-4f93-b378-38f19c57a684 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:31.466302 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9cd5a685-096e-4f93-b378-38f19c57a684 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:31.466663 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9cd5a685-096e-4f93-b378-38f19c57a684 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:31.691200 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-9cd5a685-096e-4f93-b378-38f19c57a684 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:31.701149 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-9cd5a685-096e-4f93-b378-38f19c57a684 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:31.703037 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-9cd5a685-096e-4f93-b378-38f19c57a684 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:31.704442 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-9cd5a685-096e-4f93-b378-38f19c57a684 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1721 microversion: 2.20 time: 0.253506 Jun 07 08:44:31.705709 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 350/690] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:31 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1721 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:31.993401 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-d2335f23-c133-42f6-8997-4a30bba2c418 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:31.994098 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-d2335f23-c133-42f6-8997-4a30bba2c418 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:32.001513 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d2335f23-c133-42f6-8997-4a30bba2c418 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:32.001960 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d2335f23-c133-42f6-8997-4a30bba2c418 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:32.002746 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d2335f23-c133-42f6-8997-4a30bba2c418 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:32.003234 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d2335f23-c133-42f6-8997-4a30bba2c418 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:32.090776 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-d2335f23-c133-42f6-8997-4a30bba2c418 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:32.099072 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-d2335f23-c133-42f6-8997-4a30bba2c418 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1187 microversion: 2.1 time: 0.109617 Jun 07 08:44:32.110214 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 341/691] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:44:31 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1187 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:44:32.514016 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-e1e579e6-08a3-4b26-83af-13105ee727c6 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50539cf4-087d-4b68-8921-91899a34b005"}} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:44:32.515113 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-e1e579e6-08a3-4b26-83af-13105ee727c6 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:32.521593 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e1e579e6-08a3-4b26-83af-13105ee727c6 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:32.522064 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e1e579e6-08a3-4b26-83af-13105ee727c6 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:32.522878 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e1e579e6-08a3-4b26-83af-13105ee727c6 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:32.523315 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e1e579e6-08a3-4b26-83af-13105ee727c6 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:32.723881 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-cffcc366-9d59-438d-bc13-eeee38aaf1d8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:32.724535 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-cffcc366-9d59-438d-bc13-eeee38aaf1d8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:32.732320 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-cffcc366-9d59-438d-bc13-eeee38aaf1d8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:32.732768 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-cffcc366-9d59-438d-bc13-eeee38aaf1d8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:32.733592 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-cffcc366-9d59-438d-bc13-eeee38aaf1d8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:32.734033 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-cffcc366-9d59-438d-bc13-eeee38aaf1d8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:32.870534 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-cffcc366-9d59-438d-bc13-eeee38aaf1d8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:32.879517 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-cffcc366-9d59-438d-bc13-eeee38aaf1d8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:32.882257 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-cffcc366-9d59-438d-bc13-eeee38aaf1d8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:32.882257 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-cffcc366-9d59-438d-bc13-eeee38aaf1d8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1721 microversion: 2.20 time: 0.162473 Jun 07 08:44:32.882791 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 342/692] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:32 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:44:33.117801 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-33e9b429-0d2e-472a-842c-4f65830858f1 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:33.118431 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-33e9b429-0d2e-472a-842c-4f65830858f1 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:33.130040 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-33e9b429-0d2e-472a-842c-4f65830858f1 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:33.130040 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-33e9b429-0d2e-472a-842c-4f65830858f1 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:33.130040 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-33e9b429-0d2e-472a-842c-4f65830858f1 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:33.130040 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-33e9b429-0d2e-472a-842c-4f65830858f1 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:33.199871 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-33e9b429-0d2e-472a-842c-4f65830858f1 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:33.207942 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-33e9b429-0d2e-472a-842c-4f65830858f1 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1195 microversion: 2.1 time: 0.093866 Jun 07 08:44:33.208605 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 343/693] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:44:33 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1195 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:44:33.901419 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-f892fc03-7011-4230-a1fc-050dcce9d0e0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:33.902024 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-f892fc03-7011-4230-a1fc-050dcce9d0e0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:33.912154 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f892fc03-7011-4230-a1fc-050dcce9d0e0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:33.912612 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f892fc03-7011-4230-a1fc-050dcce9d0e0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:33.913504 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f892fc03-7011-4230-a1fc-050dcce9d0e0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:33.913945 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f892fc03-7011-4230-a1fc-050dcce9d0e0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:34.096562 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-f892fc03-7011-4230-a1fc-050dcce9d0e0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:34.104927 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-f892fc03-7011-4230-a1fc-050dcce9d0e0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:34.106958 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-f892fc03-7011-4230-a1fc-050dcce9d0e0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:34.108110 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-f892fc03-7011-4230-a1fc-050dcce9d0e0 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1721 microversion: 2.20 time: 0.210957 Jun 07 08:44:34.108711 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 344/694] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:33 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1721 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:44:34.226802 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-2558c025-785c-4bf2-86ce-89a45d1ffb8f tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:34.228464 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-2558c025-785c-4bf2-86ce-89a45d1ffb8f tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:34.235813 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2558c025-785c-4bf2-86ce-89a45d1ffb8f tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:34.236569 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2558c025-785c-4bf2-86ce-89a45d1ffb8f tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:34.237602 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2558c025-785c-4bf2-86ce-89a45d1ffb8f tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:34.238247 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2558c025-785c-4bf2-86ce-89a45d1ffb8f tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:34.260355 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=100 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:44:34.322228 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-2558c025-785c-4bf2-86ce-89a45d1ffb8f tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:34.330388 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-2558c025-785c-4bf2-86ce-89a45d1ffb8f tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1195 microversion: 2.1 time: 0.108779 Jun 07 08:44:34.331679 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 345/695] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:44:34 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1195 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:44:34.775505 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-e1e579e6-08a3-4b26-83af-13105ee727c6 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "POST /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.265948 Jun 07 08:44:34.776702 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 351/696] 10.222.0.17 () {60 vars in 1322 bytes} [Tue Jun 7 08:44:32 2022] POST /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971/os-volume_attachments => generated 194 bytes in 2268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:44:35.129576 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-e0bc0e24-70aa-4f5c-b830-855176516624 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:35.130195 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-e0bc0e24-70aa-4f5c-b830-855176516624 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:35.137707 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e0bc0e24-70aa-4f5c-b830-855176516624 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:35.138410 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e0bc0e24-70aa-4f5c-b830-855176516624 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:35.139480 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e0bc0e24-70aa-4f5c-b830-855176516624 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:35.139912 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e0bc0e24-70aa-4f5c-b830-855176516624 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:35.312271 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-e0bc0e24-70aa-4f5c-b830-855176516624 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:35.329269 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-e0bc0e24-70aa-4f5c-b830-855176516624 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:35.331074 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-e0bc0e24-70aa-4f5c-b830-855176516624 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:35.333049 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-e0bc0e24-70aa-4f5c-b830-855176516624 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1724 microversion: 2.20 time: 0.208493 Jun 07 08:44:35.333628 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 346/697] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:35 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:35.349064 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-42272438-96f8-4e07-9813-47a5aae101fe tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:35.353818 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-42272438-96f8-4e07-9813-47a5aae101fe tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:35.357213 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-efaf7b05-93da-435f-b674-527f414c15e7 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "706ec2db-1372-4fdb-a475-9129f595765a"}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:44:35.359482 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-efaf7b05-93da-435f-b674-527f414c15e7 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:35.370630 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-efaf7b05-93da-435f-b674-527f414c15e7 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:35.372021 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-efaf7b05-93da-435f-b674-527f414c15e7 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:35.374773 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-efaf7b05-93da-435f-b674-527f414c15e7 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:35.375470 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-efaf7b05-93da-435f-b674-527f414c15e7 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:35.380812 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-42272438-96f8-4e07-9813-47a5aae101fe tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:35.381968 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-42272438-96f8-4e07-9813-47a5aae101fe tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:35.382764 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-42272438-96f8-4e07-9813-47a5aae101fe tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:35.383272 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-42272438-96f8-4e07-9813-47a5aae101fe tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:35.741732 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-42272438-96f8-4e07-9813-47a5aae101fe tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:35.751993 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-42272438-96f8-4e07-9813-47a5aae101fe tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1272 microversion: 2.1 time: 0.407229 Jun 07 08:44:35.753595 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 352/698] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:44:35 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1272 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:44:35.760625 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-e7bb283f-9a1c-46c6-bc0c-52bcdde59bf1 req-ef42fc62-eae2-4af0-9700-f610015452f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bff05aff-3c16-4b84-b927-eaa3917a4200", "name": "network-vif-unplugged", "status": "completed", "tag": "ac5f8c52-180a-42f4-8102-9668d2229d61"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:44:35.775027 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-e7bb283f-9a1c-46c6-bc0c-52bcdde59bf1 req-ef42fc62-eae2-4af0-9700-f610015452f7 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:35.775027 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-e7bb283f-9a1c-46c6-bc0c-52bcdde59bf1 req-ef42fc62-eae2-4af0-9700-f610015452f7 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:35.795595 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.compute.server_external_events [req-e7bb283f-9a1c-46c6-bc0c-52bcdde59bf1 req-ef42fc62-eae2-4af0-9700-f610015452f7 service nova] Unable to find a host for instance bff05aff-3c16-4b84-b927-eaa3917a4200. Dropping event network-vif-unplugged {{(pid=129725) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 07 08:44:35.796608 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-e7bb283f-9a1c-46c6-bc0c-52bcdde59bf1 req-ef42fc62-eae2-4af0-9700-f610015452f7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.041536 Jun 07 08:44:35.797701 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 353/699] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 43 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 07 08:44:35.961987 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-6af3d0e3-049d-4a9b-861b-7cbef79ea0c7 req-0c9d2428-1482-4f66-884d-81545a3ba23d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb70e18b-43bf-402d-9d70-028908bfc7fd", "tag": "c5b234fe-05ce-4bf2-a2ef-1e4c55770be9"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:44:35.972151 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-6af3d0e3-049d-4a9b-861b-7cbef79ea0c7 req-0c9d2428-1482-4f66-884d-81545a3ba23d service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:35.972770 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-6af3d0e3-049d-4a9b-861b-7cbef79ea0c7 req-0c9d2428-1482-4f66-884d-81545a3ba23d service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:35.986364 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-6af3d0e3-049d-4a9b-861b-7cbef79ea0c7 req-0c9d2428-1482-4f66-884d-81545a3ba23d service nova] Creating event network-changed:c5b234fe-05ce-4bf2-a2ef-1e4c55770be9 for instance cb70e18b-43bf-402d-9d70-028908bfc7fd on hv-cinder-74014 Jun 07 08:44:35.991542 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-6af3d0e3-049d-4a9b-861b-7cbef79ea0c7 req-0c9d2428-1482-4f66-884d-81545a3ba23d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034649 Jun 07 08:44:35.992226 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 354/700] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:44:36.771262 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-57df16c0-df4f-4df4-b655-e0c9f7507748 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:36.771953 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-57df16c0-df4f-4df4-b655-e0c9f7507748 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:36.779009 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-57df16c0-df4f-4df4-b655-e0c9f7507748 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:36.779704 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-57df16c0-df4f-4df4-b655-e0c9f7507748 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:36.780467 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-57df16c0-df4f-4df4-b655-e0c9f7507748 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:36.780916 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-57df16c0-df4f-4df4-b655-e0c9f7507748 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:36.914735 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-57df16c0-df4f-4df4-b655-e0c9f7507748 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:36.922312 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-57df16c0-df4f-4df4-b655-e0c9f7507748 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1260 microversion: 2.1 time: 0.155838 Jun 07 08:44:36.925180 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 355/701] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:44:36 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:44:37.122117 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-efaf7b05-93da-435f-b674-527f414c15e7 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "POST /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.770874 Jun 07 08:44:37.122646 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 347/702] 10.222.0.17 () {62 vars in 1363 bytes} [Tue Jun 7 08:44:35 2022] POST /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200/os-volume_attachments => generated 188 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 07 08:44:37.237835 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-425629ba-d4bf-41f1-98a6-f368faff3636 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:37.238329 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-425629ba-d4bf-41f1-98a6-f368faff3636 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:37.244254 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-425629ba-d4bf-41f1-98a6-f368faff3636 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:37.244706 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-425629ba-d4bf-41f1-98a6-f368faff3636 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:37.245516 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-425629ba-d4bf-41f1-98a6-f368faff3636 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:37.246001 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-425629ba-d4bf-41f1-98a6-f368faff3636 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:37.779945 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-425629ba-d4bf-41f1-98a6-f368faff3636 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200/os-volume_attachments/706ec2db-1372-4fdb-a475-9129f595765a" status: 202 len: 0 microversion: 2.20 time: 0.545653 Jun 07 08:44:37.780589 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 356/703] 10.222.0.17 () {60 vars in 1456 bytes} [Tue Jun 7 08:44:37 2022] DELETE /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200/os-volume_attachments/706ec2db-1372-4fdb-a475-9129f595765a => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 08:44:37.839680 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-0376be95-f21a-40aa-8a90-5cbe488560b6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:44:37.840241 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-0376be95-f21a-40aa-8a90-5cbe488560b6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:37.847320 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0376be95-f21a-40aa-8a90-5cbe488560b6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:37.847766 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0376be95-f21a-40aa-8a90-5cbe488560b6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:37.848527 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0376be95-f21a-40aa-8a90-5cbe488560b6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:37.848972 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0376be95-f21a-40aa-8a90-5cbe488560b6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:37.943349 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-e6f678f5-6477-43ba-b6d6-bebbc3e7dfe4 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:37.944492 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-e6f678f5-6477-43ba-b6d6-bebbc3e7dfe4 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:37.951992 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e6f678f5-6477-43ba-b6d6-bebbc3e7dfe4 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:37.952787 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e6f678f5-6477-43ba-b6d6-bebbc3e7dfe4 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:37.954125 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e6f678f5-6477-43ba-b6d6-bebbc3e7dfe4 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:37.954125 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e6f678f5-6477-43ba-b6d6-bebbc3e7dfe4 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:38.094228 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-e6f678f5-6477-43ba-b6d6-bebbc3e7dfe4 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:38.101539 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-e6f678f5-6477-43ba-b6d6-bebbc3e7dfe4 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1260 microversion: 2.1 time: 0.165207 Jun 07 08:44:38.102194 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 357/704] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:44:37 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:44:38.187750 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-0376be95-f21a-40aa-8a90-5cbe488560b6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "POST /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200/action" status: 202 len: 0 microversion: 2.20 time: 0.351774 Jun 07 08:44:38.189081 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 348/705] 10.222.0.17 () {62 vars in 1318 bytes} [Tue Jun 7 08:44:37 2022] POST /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 07 08:44:38.196279 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-e442c2b9-b8fb-4773-92ed-f9653decd43a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:38.197006 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-e442c2b9-b8fb-4773-92ed-f9653decd43a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:38.203296 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e442c2b9-b8fb-4773-92ed-f9653decd43a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:38.203744 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e442c2b9-b8fb-4773-92ed-f9653decd43a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:38.205248 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e442c2b9-b8fb-4773-92ed-f9653decd43a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:38.205248 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e442c2b9-b8fb-4773-92ed-f9653decd43a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:38.338801 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-e442c2b9-b8fb-4773-92ed-f9653decd43a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:38.347268 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-e442c2b9-b8fb-4773-92ed-f9653decd43a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:38.348793 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-e442c2b9-b8fb-4773-92ed-f9653decd43a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:38.349942 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-e442c2b9-b8fb-4773-92ed-f9653decd43a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1672 microversion: 2.20 time: 0.157543 Jun 07 08:44:38.350502 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 358/706] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:38 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:39.118509 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-bc76f647-a8e8-486b-9d2c-f34462fc34f1 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:39.119128 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-bc76f647-a8e8-486b-9d2c-f34462fc34f1 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:39.125306 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-bc76f647-a8e8-486b-9d2c-f34462fc34f1 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:39.125764 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-bc76f647-a8e8-486b-9d2c-f34462fc34f1 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:39.126536 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-bc76f647-a8e8-486b-9d2c-f34462fc34f1 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:39.127140 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-bc76f647-a8e8-486b-9d2c-f34462fc34f1 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:39.264203 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-bc76f647-a8e8-486b-9d2c-f34462fc34f1 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:39.271195 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-bc76f647-a8e8-486b-9d2c-f34462fc34f1 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1260 microversion: 2.1 time: 0.156870 Jun 07 08:44:39.271769 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 349/707] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:44:39 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:44:39.369886 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-822da022-ca56-453b-904e-a6e3cbfcaa19 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:39.370886 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-822da022-ca56-453b-904e-a6e3cbfcaa19 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:39.374421 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell0:SELECT=2 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:44:39.376419 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell0:SELECT=6 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:44:39.381788 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-822da022-ca56-453b-904e-a6e3cbfcaa19 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:39.382650 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-822da022-ca56-453b-904e-a6e3cbfcaa19 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:39.383538 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-822da022-ca56-453b-904e-a6e3cbfcaa19 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:39.384036 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-822da022-ca56-453b-904e-a6e3cbfcaa19 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:39.524810 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-822da022-ca56-453b-904e-a6e3cbfcaa19 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:39.525608 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:44:39.533502 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-822da022-ca56-453b-904e-a6e3cbfcaa19 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:39.534990 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-822da022-ca56-453b-904e-a6e3cbfcaa19 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:39.536515 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-822da022-ca56-453b-904e-a6e3cbfcaa19 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1672 microversion: 2.20 time: 0.172582 Jun 07 08:44:39.537325 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 359/708] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:39 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1672 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:40.289013 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-fbd56065-89f4-480e-a638-49b5aba87c51 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:40.289626 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-fbd56065-89f4-480e-a638-49b5aba87c51 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:40.296136 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fbd56065-89f4-480e-a638-49b5aba87c51 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:40.296590 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fbd56065-89f4-480e-a638-49b5aba87c51 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:40.297386 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fbd56065-89f4-480e-a638-49b5aba87c51 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:40.297824 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fbd56065-89f4-480e-a638-49b5aba87c51 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:40.430499 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-fbd56065-89f4-480e-a638-49b5aba87c51 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:40.437720 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-fbd56065-89f4-480e-a638-49b5aba87c51 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1260 microversion: 2.1 time: 0.152591 Jun 07 08:44:40.438308 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 350/709] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:44:40 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:44:40.555091 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-a38e63de-67f6-4fcd-bf11-81536b9d9443 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:40.555813 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-a38e63de-67f6-4fcd-bf11-81536b9d9443 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:40.564348 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a38e63de-67f6-4fcd-bf11-81536b9d9443 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:40.565284 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a38e63de-67f6-4fcd-bf11-81536b9d9443 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:40.566064 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a38e63de-67f6-4fcd-bf11-81536b9d9443 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:40.566952 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a38e63de-67f6-4fcd-bf11-81536b9d9443 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:41.041599 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-a38e63de-67f6-4fcd-bf11-81536b9d9443 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:41.050146 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-a38e63de-67f6-4fcd-bf11-81536b9d9443 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:41.051649 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-a38e63de-67f6-4fcd-bf11-81536b9d9443 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:41.052805 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-a38e63de-67f6-4fcd-bf11-81536b9d9443 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1730 microversion: 2.20 time: 0.501618 Jun 07 08:44:41.053399 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 360/710] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:40 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1730 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:44:41.455303 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-dab72140-904b-4c32-b3e0-c0eaa1b5ac0f tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:41.455930 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-dab72140-904b-4c32-b3e0-c0eaa1b5ac0f tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:41.457885 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell0:SELECT=4 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:44:41.463376 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-dab72140-904b-4c32-b3e0-c0eaa1b5ac0f tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:41.463827 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-dab72140-904b-4c32-b3e0-c0eaa1b5ac0f tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:41.464586 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-dab72140-904b-4c32-b3e0-c0eaa1b5ac0f tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:41.465643 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-dab72140-904b-4c32-b3e0-c0eaa1b5ac0f tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:41.605837 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-dab72140-904b-4c32-b3e0-c0eaa1b5ac0f tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:41.613381 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-dab72140-904b-4c32-b3e0-c0eaa1b5ac0f tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1260 microversion: 2.1 time: 0.161831 Jun 07 08:44:41.613995 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 351/711] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:44:41 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:44:42.070862 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-ba610ca2-5616-4cb2-80c7-90483b092280 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:42.076512 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-ba610ca2-5616-4cb2-80c7-90483b092280 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:42.078432 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ba610ca2-5616-4cb2-80c7-90483b092280 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:42.078948 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ba610ca2-5616-4cb2-80c7-90483b092280 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:42.079800 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ba610ca2-5616-4cb2-80c7-90483b092280 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:42.080346 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ba610ca2-5616-4cb2-80c7-90483b092280 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:42.232555 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-ba610ca2-5616-4cb2-80c7-90483b092280 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:42.240904 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-ba610ca2-5616-4cb2-80c7-90483b092280 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:42.242451 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-ba610ca2-5616-4cb2-80c7-90483b092280 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:42.243612 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-ba610ca2-5616-4cb2-80c7-90483b092280 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1730 microversion: 2.20 time: 0.176773 Jun 07 08:44:42.244169 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 361/712] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:42 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:42.631088 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-048b2d84-bc0a-481b-b530-8b558dcfa094 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:42.631799 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-048b2d84-bc0a-481b-b530-8b558dcfa094 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:42.639234 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-048b2d84-bc0a-481b-b530-8b558dcfa094 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:42.639734 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-048b2d84-bc0a-481b-b530-8b558dcfa094 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:42.640548 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-048b2d84-bc0a-481b-b530-8b558dcfa094 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:42.640950 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-048b2d84-bc0a-481b-b530-8b558dcfa094 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:42.823933 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-048b2d84-bc0a-481b-b530-8b558dcfa094 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:42.833383 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-048b2d84-bc0a-481b-b530-8b558dcfa094 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1260 microversion: 2.1 time: 0.205990 Jun 07 08:44:42.844110 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 352/713] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:44:42 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1260 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:44:43.262143 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-c9315218-61a0-4d96-901c-bdc1ddc6c1f5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:43.262834 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-c9315218-61a0-4d96-901c-bdc1ddc6c1f5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:43.269233 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c9315218-61a0-4d96-901c-bdc1ddc6c1f5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:43.269682 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c9315218-61a0-4d96-901c-bdc1ddc6c1f5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:43.270451 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c9315218-61a0-4d96-901c-bdc1ddc6c1f5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:43.270880 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c9315218-61a0-4d96-901c-bdc1ddc6c1f5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:43.413941 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-c9315218-61a0-4d96-901c-bdc1ddc6c1f5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:43.423069 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-c9315218-61a0-4d96-901c-bdc1ddc6c1f5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:43.424587 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-c9315218-61a0-4d96-901c-bdc1ddc6c1f5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:43.426033 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-c9315218-61a0-4d96-901c-bdc1ddc6c1f5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1730 microversion: 2.20 time: 0.167804 Jun 07 08:44:43.426880 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 362/714] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:43 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:43.850812 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-092255e6-ea7d-48a9-8456-3506beddc98b tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:43.852033 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-092255e6-ea7d-48a9-8456-3506beddc98b tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:43.861645 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-092255e6-ea7d-48a9-8456-3506beddc98b tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:43.862440 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-092255e6-ea7d-48a9-8456-3506beddc98b tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:43.863426 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-092255e6-ea7d-48a9-8456-3506beddc98b tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:43.864080 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-092255e6-ea7d-48a9-8456-3506beddc98b tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:44.010098 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-092255e6-ea7d-48a9-8456-3506beddc98b tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:44.019301 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-092255e6-ea7d-48a9-8456-3506beddc98b tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1260 microversion: 2.1 time: 0.172368 Jun 07 08:44:44.020516 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 353/715] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:44:43 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:44:44.444991 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-0889ec8f-d982-4246-9899-44408b29499b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:44.445649 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-0889ec8f-d982-4246-9899-44408b29499b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:44.452960 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0889ec8f-d982-4246-9899-44408b29499b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:44.453439 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0889ec8f-d982-4246-9899-44408b29499b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:44.454248 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0889ec8f-d982-4246-9899-44408b29499b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:44.454864 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0889ec8f-d982-4246-9899-44408b29499b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:44.599860 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-0889ec8f-d982-4246-9899-44408b29499b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:44.608938 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-0889ec8f-d982-4246-9899-44408b29499b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:44.610494 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-0889ec8f-d982-4246-9899-44408b29499b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:44.611766 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-0889ec8f-d982-4246-9899-44408b29499b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1730 microversion: 2.20 time: 0.171516 Jun 07 08:44:44.612377 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 363/716] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:44 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:45.043999 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-5e2cb4d8-c15f-4753-83af-b6ed042c045c tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:45.046286 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-5e2cb4d8-c15f-4753-83af-b6ed042c045c tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:45.051329 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_api:SELECT=58 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:44:45.060336 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5e2cb4d8-c15f-4753-83af-b6ed042c045c tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:45.060916 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5e2cb4d8-c15f-4753-83af-b6ed042c045c tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:45.064845 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5e2cb4d8-c15f-4753-83af-b6ed042c045c tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:45.064845 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5e2cb4d8-c15f-4753-83af-b6ed042c045c tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:45.215978 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-5e2cb4d8-c15f-4753-83af-b6ed042c045c tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:45.224849 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-5e2cb4d8-c15f-4753-83af-b6ed042c045c tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1260 microversion: 2.1 time: 0.187879 Jun 07 08:44:45.226166 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 354/717] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:44:45 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:44:45.630240 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-3f343737-15cb-4f02-bcfd-925e26e20159 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:45.630908 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-3f343737-15cb-4f02-bcfd-925e26e20159 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:45.637891 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3f343737-15cb-4f02-bcfd-925e26e20159 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:45.638499 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3f343737-15cb-4f02-bcfd-925e26e20159 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:45.639283 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3f343737-15cb-4f02-bcfd-925e26e20159 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:45.639719 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3f343737-15cb-4f02-bcfd-925e26e20159 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:45.799791 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-3f343737-15cb-4f02-bcfd-925e26e20159 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:45.812817 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-3f343737-15cb-4f02-bcfd-925e26e20159 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:45.814510 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-3f343737-15cb-4f02-bcfd-925e26e20159 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:45.815674 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-3f343737-15cb-4f02-bcfd-925e26e20159 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1730 microversion: 2.20 time: 0.189482 Jun 07 08:44:45.816251 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 364/718] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:45 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:46.242799 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-aa466c28-f428-4a39-8bbd-95dcafa30b36 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:46.243522 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-aa466c28-f428-4a39-8bbd-95dcafa30b36 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:46.251005 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-aa466c28-f428-4a39-8bbd-95dcafa30b36 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:46.251516 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-aa466c28-f428-4a39-8bbd-95dcafa30b36 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:46.252656 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-aa466c28-f428-4a39-8bbd-95dcafa30b36 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:46.253181 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-aa466c28-f428-4a39-8bbd-95dcafa30b36 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:46.400023 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-aa466c28-f428-4a39-8bbd-95dcafa30b36 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:46.408956 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-aa466c28-f428-4a39-8bbd-95dcafa30b36 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1260 microversion: 2.1 time: 0.170510 Jun 07 08:44:46.409630 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 355/719] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:44:46 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:44:46.836025 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-efd487c8-766d-4fe7-8051-e81c18a0fcb5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:46.836766 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-efd487c8-766d-4fe7-8051-e81c18a0fcb5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:46.845306 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-efd487c8-766d-4fe7-8051-e81c18a0fcb5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:46.845757 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-efd487c8-766d-4fe7-8051-e81c18a0fcb5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:46.846538 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-efd487c8-766d-4fe7-8051-e81c18a0fcb5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:46.846978 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-efd487c8-766d-4fe7-8051-e81c18a0fcb5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:47.023201 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-efd487c8-766d-4fe7-8051-e81c18a0fcb5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:47.039755 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-efd487c8-766d-4fe7-8051-e81c18a0fcb5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:47.041202 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-efd487c8-766d-4fe7-8051-e81c18a0fcb5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:47.042381 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-efd487c8-766d-4fe7-8051-e81c18a0fcb5 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1730 microversion: 2.20 time: 0.211834 Jun 07 08:44:47.043859 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 365/720] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:46 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1730 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:47.425850 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-eb745769-15e2-4b85-a0ba-a460ee021b21 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:47.427397 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-eb745769-15e2-4b85-a0ba-a460ee021b21 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:47.435695 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-eb745769-15e2-4b85-a0ba-a460ee021b21 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:47.436198 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-eb745769-15e2-4b85-a0ba-a460ee021b21 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:47.437290 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-eb745769-15e2-4b85-a0ba-a460ee021b21 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:47.438065 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-eb745769-15e2-4b85-a0ba-a460ee021b21 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:47.588895 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-eb745769-15e2-4b85-a0ba-a460ee021b21 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:47.597156 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-eb745769-15e2-4b85-a0ba-a460ee021b21 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1260 microversion: 2.1 time: 0.175297 Jun 07 08:44:47.597730 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 356/721] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:44:47 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:44:48.063655 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-79c81989-3862-4b6b-8d52-1ed5bca2843c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:48.064360 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-79c81989-3862-4b6b-8d52-1ed5bca2843c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:48.076716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-79c81989-3862-4b6b-8d52-1ed5bca2843c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:48.077306 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-79c81989-3862-4b6b-8d52-1ed5bca2843c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:48.078928 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-79c81989-3862-4b6b-8d52-1ed5bca2843c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:48.080258 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-79c81989-3862-4b6b-8d52-1ed5bca2843c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:48.217035 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-79c81989-3862-4b6b-8d52-1ed5bca2843c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:48.227084 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-79c81989-3862-4b6b-8d52-1ed5bca2843c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:48.228880 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-79c81989-3862-4b6b-8d52-1ed5bca2843c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:48.230716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-79c81989-3862-4b6b-8d52-1ed5bca2843c tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1730 microversion: 2.20 time: 0.171943 Jun 07 08:44:48.240704 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 366/722] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:48 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:48.613821 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-e938868b-e505-4f4d-adcb-a6648d64be93 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:48.615002 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-e938868b-e505-4f4d-adcb-a6648d64be93 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:48.624603 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e938868b-e505-4f4d-adcb-a6648d64be93 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:48.625416 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e938868b-e505-4f4d-adcb-a6648d64be93 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:48.626981 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e938868b-e505-4f4d-adcb-a6648d64be93 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:48.627708 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e938868b-e505-4f4d-adcb-a6648d64be93 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:48.786266 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-e938868b-e505-4f4d-adcb-a6648d64be93 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:48.795864 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-e938868b-e505-4f4d-adcb-a6648d64be93 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1260 microversion: 2.1 time: 0.185706 Jun 07 08:44:48.796445 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 357/723] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:44:48 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:44:49.250020 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-9e2e041f-32e9-4dd3-9970-0df21e766e49 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:49.254787 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-9e2e041f-32e9-4dd3-9970-0df21e766e49 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:49.258328 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9e2e041f-32e9-4dd3-9970-0df21e766e49 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:49.259117 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9e2e041f-32e9-4dd3-9970-0df21e766e49 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:49.260401 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9e2e041f-32e9-4dd3-9970-0df21e766e49 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:49.260890 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9e2e041f-32e9-4dd3-9970-0df21e766e49 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:49.437993 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-9e2e041f-32e9-4dd3-9970-0df21e766e49 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:49.452512 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-9e2e041f-32e9-4dd3-9970-0df21e766e49 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:49.454446 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-9e2e041f-32e9-4dd3-9970-0df21e766e49 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:49.455638 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-9e2e041f-32e9-4dd3-9970-0df21e766e49 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1730 microversion: 2.20 time: 0.210557 Jun 07 08:44:49.456278 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 367/724] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:49 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1730 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:49.815157 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-05ed5c01-6a84-4915-8b90-abf799711150 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:49.816673 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-05ed5c01-6a84-4915-8b90-abf799711150 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:49.824084 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-05ed5c01-6a84-4915-8b90-abf799711150 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:49.824734 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-05ed5c01-6a84-4915-8b90-abf799711150 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:49.825849 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-05ed5c01-6a84-4915-8b90-abf799711150 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:49.826318 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-05ed5c01-6a84-4915-8b90-abf799711150 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:49.829059 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:44:49.979219 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-05ed5c01-6a84-4915-8b90-abf799711150 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:49.987637 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-05ed5c01-6a84-4915-8b90-abf799711150 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1260 microversion: 2.1 time: 0.177441 Jun 07 08:44:49.988791 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 358/725] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:44:49 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:44:50.473996 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-ec75fe71-0846-4e3e-b6fd-e593dda64d41 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:50.476218 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-ec75fe71-0846-4e3e-b6fd-e593dda64d41 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:50.482905 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ec75fe71-0846-4e3e-b6fd-e593dda64d41 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:50.483384 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ec75fe71-0846-4e3e-b6fd-e593dda64d41 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:50.484163 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ec75fe71-0846-4e3e-b6fd-e593dda64d41 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:50.484597 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ec75fe71-0846-4e3e-b6fd-e593dda64d41 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:50.630060 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-ec75fe71-0846-4e3e-b6fd-e593dda64d41 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:50.639004 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-ec75fe71-0846-4e3e-b6fd-e593dda64d41 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:50.640710 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-ec75fe71-0846-4e3e-b6fd-e593dda64d41 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:50.642078 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-ec75fe71-0846-4e3e-b6fd-e593dda64d41 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1730 microversion: 2.20 time: 0.172153 Jun 07 08:44:50.642727 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 368/726] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:50 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:51.009636 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-505f62ae-4c4d-4703-877a-f2b1f8037e30 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:51.010383 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-505f62ae-4c4d-4703-877a-f2b1f8037e30 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:51.017572 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-505f62ae-4c4d-4703-877a-f2b1f8037e30 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:51.018035 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-505f62ae-4c4d-4703-877a-f2b1f8037e30 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:51.018818 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-505f62ae-4c4d-4703-877a-f2b1f8037e30 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:51.019251 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-505f62ae-4c4d-4703-877a-f2b1f8037e30 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:51.158159 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-505f62ae-4c4d-4703-877a-f2b1f8037e30 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:51.167337 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-505f62ae-4c4d-4703-877a-f2b1f8037e30 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1260 microversion: 2.1 time: 0.161432 Jun 07 08:44:51.168581 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 359/727] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:44:51 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:44:51.660935 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-53c90a4a-459d-489b-a3af-3657aa29e91f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:51.661576 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-53c90a4a-459d-489b-a3af-3657aa29e91f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:51.670390 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-53c90a4a-459d-489b-a3af-3657aa29e91f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:51.670836 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-53c90a4a-459d-489b-a3af-3657aa29e91f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:51.671600 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-53c90a4a-459d-489b-a3af-3657aa29e91f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:51.672028 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-53c90a4a-459d-489b-a3af-3657aa29e91f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:51.813764 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-53c90a4a-459d-489b-a3af-3657aa29e91f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:51.821674 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-53c90a4a-459d-489b-a3af-3657aa29e91f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:51.823170 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-53c90a4a-459d-489b-a3af-3657aa29e91f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:51.824342 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-53c90a4a-459d-489b-a3af-3657aa29e91f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1730 microversion: 2.20 time: 0.167229 Jun 07 08:44:51.824906 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 369/728] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:51 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:52.187607 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-5d48b262-3d6f-4fbe-9933-828acc5813de tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:52.188218 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-5d48b262-3d6f-4fbe-9933-828acc5813de tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:52.194938 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5d48b262-3d6f-4fbe-9933-828acc5813de tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:52.195385 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5d48b262-3d6f-4fbe-9933-828acc5813de tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:52.196143 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5d48b262-3d6f-4fbe-9933-828acc5813de tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:52.196577 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5d48b262-3d6f-4fbe-9933-828acc5813de tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:52.340250 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-5d48b262-3d6f-4fbe-9933-828acc5813de tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:52.348084 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-5d48b262-3d6f-4fbe-9933-828acc5813de tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1260 microversion: 2.1 time: 0.164277 Jun 07 08:44:52.348750 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 360/729] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:44:52 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:44:52.409932 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-cbf24f50-3d4d-4b58-b9d9-3af884575d53 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:52.410917 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-cbf24f50-3d4d-4b58-b9d9-3af884575d53 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:52.417167 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-cbf24f50-3d4d-4b58-b9d9-3af884575d53 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:52.418420 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-cbf24f50-3d4d-4b58-b9d9-3af884575d53 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:52.418993 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-cbf24f50-3d4d-4b58-b9d9-3af884575d53 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:52.419439 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-cbf24f50-3d4d-4b58-b9d9-3af884575d53 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:52.449573 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-cbf24f50-3d4d-4b58-b9d9-3af884575d53 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043706 Jun 07 08:44:52.450128 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 370/730] 10.222.0.17 () {58 vars in 1301 bytes} [Tue Jun 7 08:44:52 2022] GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:44:52.592314 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-bf727b06-a20e-4a31-a6c9-9a0e87ed279d tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:52.592918 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-bf727b06-a20e-4a31-a6c9-9a0e87ed279d tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:52.598930 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-bf727b06-a20e-4a31-a6c9-9a0e87ed279d tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:52.599322 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-bf727b06-a20e-4a31-a6c9-9a0e87ed279d tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:52.600077 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-bf727b06-a20e-4a31-a6c9-9a0e87ed279d tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:52.600510 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-bf727b06-a20e-4a31-a6c9-9a0e87ed279d tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:52.628430 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-bf727b06-a20e-4a31-a6c9-9a0e87ed279d tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971/os-volume_attachments/5ecc8ac5-df10-4ef5-9753-4767ecf3c7b9" status: 200 len: 194 microversion: 2.1 time: 0.040662 Jun 07 08:44:52.629005 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 361/731] 10.222.0.17 () {58 vars in 1412 bytes} [Tue Jun 7 08:44:52 2022] GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971/os-volume_attachments/5ecc8ac5-df10-4ef5-9753-4767ecf3c7b9 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:44:52.638821 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-3bb5d624-024e-4bb9-8d70-063f6a5ef525 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:52.639317 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-3bb5d624-024e-4bb9-8d70-063f6a5ef525 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:52.645388 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3bb5d624-024e-4bb9-8d70-063f6a5ef525 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:52.645840 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3bb5d624-024e-4bb9-8d70-063f6a5ef525 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:52.646629 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3bb5d624-024e-4bb9-8d70-063f6a5ef525 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:52.647049 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3bb5d624-024e-4bb9-8d70-063f6a5ef525 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:52.733715 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.objects.instance [None req-3bb5d624-024e-4bb9-8d70-063f6a5ef525 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lazy-loading 'services' on Instance uuid 7de79795-1332-477d-a70a-f1e87b662971 {{(pid=129725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:44:52.842517 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-010e99e3-e7dd-4ac5-892d-d1d43c4bc3e8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:52.845609 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-010e99e3-e7dd-4ac5-892d-d1d43c4bc3e8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:52.849289 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-010e99e3-e7dd-4ac5-892d-d1d43c4bc3e8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:52.849662 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-010e99e3-e7dd-4ac5-892d-d1d43c4bc3e8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:52.850426 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-010e99e3-e7dd-4ac5-892d-d1d43c4bc3e8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:52.850866 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-010e99e3-e7dd-4ac5-892d-d1d43c4bc3e8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:52.934207 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-3bb5d624-024e-4bb9-8d70-063f6a5ef525 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971/os-volume_attachments/5ecc8ac5-df10-4ef5-9753-4767ecf3c7b9" status: 202 len: 0 microversion: 2.1 time: 0.299211 Jun 07 08:44:52.934781 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 371/732] 10.222.0.17 () {58 vars in 1415 bytes} [Tue Jun 7 08:44:52 2022] DELETE /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971/os-volume_attachments/5ecc8ac5-df10-4ef5-9753-4767ecf3c7b9 => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 08:44:52.996803 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-010e99e3-e7dd-4ac5-892d-d1d43c4bc3e8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:53.001916 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-010e99e3-e7dd-4ac5-892d-d1d43c4bc3e8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:53.001916 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-010e99e3-e7dd-4ac5-892d-d1d43c4bc3e8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:53.001916 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-010e99e3-e7dd-4ac5-892d-d1d43c4bc3e8 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1730 microversion: 2.20 time: 0.162495 Jun 07 08:44:53.002236 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 362/733] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:52 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:53.366940 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-eb804dd0-8479-429c-9634-d1335ba4632e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:53.367917 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-eb804dd0-8479-429c-9634-d1335ba4632e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:53.375077 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-eb804dd0-8479-429c-9634-d1335ba4632e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:53.375748 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-eb804dd0-8479-429c-9634-d1335ba4632e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:53.376701 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-eb804dd0-8479-429c-9634-d1335ba4632e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:53.377482 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-eb804dd0-8479-429c-9634-d1335ba4632e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:53.611325 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-eb804dd0-8479-429c-9634-d1335ba4632e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:53.620240 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-eb804dd0-8479-429c-9634-d1335ba4632e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1260 microversion: 2.1 time: 0.257370 Jun 07 08:44:53.621275 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 372/734] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:44:53 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1260 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:44:54.018523 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-8d650d31-ff3a-419f-8217-1499168a0f3b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:54.019942 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-8d650d31-ff3a-419f-8217-1499168a0f3b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:54.026256 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8d650d31-ff3a-419f-8217-1499168a0f3b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:54.026911 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8d650d31-ff3a-419f-8217-1499168a0f3b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:54.027899 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8d650d31-ff3a-419f-8217-1499168a0f3b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:54.028488 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8d650d31-ff3a-419f-8217-1499168a0f3b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:54.190203 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-8d650d31-ff3a-419f-8217-1499168a0f3b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:54.199443 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-8d650d31-ff3a-419f-8217-1499168a0f3b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:54.200709 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-8d650d31-ff3a-419f-8217-1499168a0f3b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:54.202139 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-8d650d31-ff3a-419f-8217-1499168a0f3b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1730 microversion: 2.20 time: 0.187576 Jun 07 08:44:54.202689 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 363/735] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:54 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:54.639972 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-6b735054-d310-4708-88bf-15229346130a tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:54.641443 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-6b735054-d310-4708-88bf-15229346130a tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:54.649425 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6b735054-d310-4708-88bf-15229346130a tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:54.649961 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6b735054-d310-4708-88bf-15229346130a tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:54.650809 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6b735054-d310-4708-88bf-15229346130a tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:54.651582 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6b735054-d310-4708-88bf-15229346130a tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:54.797019 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-6b735054-d310-4708-88bf-15229346130a tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:54.804485 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-6b735054-d310-4708-88bf-15229346130a tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1260 microversion: 2.1 time: 0.170319 Jun 07 08:44:54.805075 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 373/736] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:44:54 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:44:55.132866 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-1839ddc3-852c-48ca-9c60-cd8e12dfa62d tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:55.133552 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-1839ddc3-852c-48ca-9c60-cd8e12dfa62d tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:55.140558 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1839ddc3-852c-48ca-9c60-cd8e12dfa62d tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:55.141019 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1839ddc3-852c-48ca-9c60-cd8e12dfa62d tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:55.141790 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1839ddc3-852c-48ca-9c60-cd8e12dfa62d tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:55.142230 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1839ddc3-852c-48ca-9c60-cd8e12dfa62d tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:55.173405 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-1839ddc3-852c-48ca-9c60-cd8e12dfa62d tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971/os-volume_attachments/50539cf4-087d-4b68-8921-91899a34b005" status: 200 len: 194 microversion: 2.1 time: 0.044371 Jun 07 08:44:55.174005 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 364/737] 10.222.0.17 () {58 vars in 1412 bytes} [Tue Jun 7 08:44:55 2022] GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971/os-volume_attachments/50539cf4-087d-4b68-8921-91899a34b005 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:44:55.183704 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-51c9fac7-534e-4614-8d58-e0edca87c89c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:55.184733 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-51c9fac7-534e-4614-8d58-e0edca87c89c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:55.190805 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-51c9fac7-534e-4614-8d58-e0edca87c89c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:55.191250 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-51c9fac7-534e-4614-8d58-e0edca87c89c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:55.192009 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-51c9fac7-534e-4614-8d58-e0edca87c89c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:55.192442 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-51c9fac7-534e-4614-8d58-e0edca87c89c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:55.219911 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-2c4fb858-1f78-46c3-b95b-e7f7c5c6d3f9 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:55.220661 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-2c4fb858-1f78-46c3-b95b-e7f7c5c6d3f9 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:55.226959 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2c4fb858-1f78-46c3-b95b-e7f7c5c6d3f9 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:55.232505 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2c4fb858-1f78-46c3-b95b-e7f7c5c6d3f9 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:55.232505 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2c4fb858-1f78-46c3-b95b-e7f7c5c6d3f9 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:55.232505 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2c4fb858-1f78-46c3-b95b-e7f7c5c6d3f9 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:55.281656 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.objects.instance [None req-51c9fac7-534e-4614-8d58-e0edca87c89c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lazy-loading 'services' on Instance uuid 7de79795-1332-477d-a70a-f1e87b662971 {{(pid=129725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:44:55.407026 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-2c4fb858-1f78-46c3-b95b-e7f7c5c6d3f9 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:55.417785 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-2c4fb858-1f78-46c3-b95b-e7f7c5c6d3f9 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:55.419969 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-2c4fb858-1f78-46c3-b95b-e7f7c5c6d3f9 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:55.421465 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-2c4fb858-1f78-46c3-b95b-e7f7c5c6d3f9 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1730 microversion: 2.20 time: 0.205398 Jun 07 08:44:55.422442 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 365/738] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:55 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1730 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:44:55.647753 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-51c9fac7-534e-4614-8d58-e0edca87c89c tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971/os-volume_attachments/50539cf4-087d-4b68-8921-91899a34b005" status: 202 len: 0 microversion: 2.1 time: 0.464608 Jun 07 08:44:55.647753 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 374/739] 10.222.0.17 () {58 vars in 1415 bytes} [Tue Jun 7 08:44:55 2022] DELETE /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971/os-volume_attachments/50539cf4-087d-4b68-8921-91899a34b005 => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 08:44:55.730424 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-9ebcb40f-c526-4a39-9086-482b95c79dcc req-c3672ce6-858e-4cf8-8792-e9ef4babd04e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bff05aff-3c16-4b84-b927-eaa3917a4200", "name": "network-vif-plugged", "status": "completed", "tag": "ac5f8c52-180a-42f4-8102-9668d2229d61"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:44:55.740298 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-9ebcb40f-c526-4a39-9086-482b95c79dcc req-c3672ce6-858e-4cf8-8792-e9ef4babd04e service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:55.740738 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-9ebcb40f-c526-4a39-9086-482b95c79dcc req-c3672ce6-858e-4cf8-8792-e9ef4babd04e service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:55.753723 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-9ebcb40f-c526-4a39-9086-482b95c79dcc req-c3672ce6-858e-4cf8-8792-e9ef4babd04e service nova] Creating event network-vif-plugged:ac5f8c52-180a-42f4-8102-9668d2229d61 for instance bff05aff-3c16-4b84-b927-eaa3917a4200 on hv-cinder-74014 Jun 07 08:44:55.758976 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-9ebcb40f-c526-4a39-9086-482b95c79dcc req-c3672ce6-858e-4cf8-8792-e9ef4babd04e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032259 Jun 07 08:44:55.759560 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 366/740] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:44:55.825601 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-5fe924e1-bdb3-4763-81ce-f5b825ce7543 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:55.826841 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-5fe924e1-bdb3-4763-81ce-f5b825ce7543 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:55.837634 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5fe924e1-bdb3-4763-81ce-f5b825ce7543 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:55.838148 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5fe924e1-bdb3-4763-81ce-f5b825ce7543 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:55.839328 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5fe924e1-bdb3-4763-81ce-f5b825ce7543 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:55.841339 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5fe924e1-bdb3-4763-81ce-f5b825ce7543 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:55.850696 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:44:55.998978 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-5fe924e1-bdb3-4763-81ce-f5b825ce7543 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:56.007449 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-5fe924e1-bdb3-4763-81ce-f5b825ce7543 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1260 microversion: 2.1 time: 0.188627 Jun 07 08:44:56.008246 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 375/741] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:44:55 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1260 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:44:56.440556 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-0ea64649-0ffa-4439-95d7-9a8394d8c31f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:56.441940 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-0ea64649-0ffa-4439-95d7-9a8394d8c31f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:56.450384 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0ea64649-0ffa-4439-95d7-9a8394d8c31f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:56.450837 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0ea64649-0ffa-4439-95d7-9a8394d8c31f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:56.453545 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0ea64649-0ffa-4439-95d7-9a8394d8c31f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:56.454171 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0ea64649-0ffa-4439-95d7-9a8394d8c31f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:56.633742 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-0ea64649-0ffa-4439-95d7-9a8394d8c31f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:56.643001 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-0ea64649-0ffa-4439-95d7-9a8394d8c31f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:56.644534 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-0ea64649-0ffa-4439-95d7-9a8394d8c31f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:56.645942 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-0ea64649-0ffa-4439-95d7-9a8394d8c31f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1730 microversion: 2.20 time: 0.209496 Jun 07 08:44:56.646505 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 367/742] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:56 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1730 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:56.830328 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-4a07ee28-01f7-4b0a-908b-b994ae467188 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:56.831319 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-4a07ee28-01f7-4b0a-908b-b994ae467188 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:56.833983 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:44:56.839757 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4a07ee28-01f7-4b0a-908b-b994ae467188 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:56.840308 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4a07ee28-01f7-4b0a-908b-b994ae467188 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:56.841119 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4a07ee28-01f7-4b0a-908b-b994ae467188 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:56.841571 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4a07ee28-01f7-4b0a-908b-b994ae467188 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:56.871396 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-4a07ee28-01f7-4b0a-908b-b994ae467188 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046038 Jun 07 08:44:56.872505 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 376/743] 10.222.0.17 () {58 vars in 1301 bytes} [Tue Jun 7 08:44:56 2022] GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 08:44:56.977918 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-3f938b9e-8eb5-4cfd-b1bd-9bcfa1b1abf0 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:56.978845 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-3f938b9e-8eb5-4cfd-b1bd-9bcfa1b1abf0 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:56.986129 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3f938b9e-8eb5-4cfd-b1bd-9bcfa1b1abf0 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:56.986586 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3f938b9e-8eb5-4cfd-b1bd-9bcfa1b1abf0 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:56.987368 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3f938b9e-8eb5-4cfd-b1bd-9bcfa1b1abf0 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:56.987790 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3f938b9e-8eb5-4cfd-b1bd-9bcfa1b1abf0 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:57.017826 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-3f938b9e-8eb5-4cfd-b1bd-9bcfa1b1abf0 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043620 Jun 07 08:44:57.018315 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 368/744] 10.222.0.17 () {58 vars in 1301 bytes} [Tue Jun 7 08:44:56 2022] GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 08:44:57.026959 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-d1396910-fe22-459c-a119-52592af97fcf tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:57.027679 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-d1396910-fe22-459c-a119-52592af97fcf tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:57.040927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d1396910-fe22-459c-a119-52592af97fcf tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:57.041412 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d1396910-fe22-459c-a119-52592af97fcf tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:57.042190 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d1396910-fe22-459c-a119-52592af97fcf tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:57.042682 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d1396910-fe22-459c-a119-52592af97fcf tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:57.093446 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-75617390-70c8-4040-81f5-88ac29c5c475 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:57.094102 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-75617390-70c8-4040-81f5-88ac29c5c475 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:57.100552 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-75617390-70c8-4040-81f5-88ac29c5c475 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:57.101786 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-75617390-70c8-4040-81f5-88ac29c5c475 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:57.102050 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-75617390-70c8-4040-81f5-88ac29c5c475 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:57.102533 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-75617390-70c8-4040-81f5-88ac29c5c475 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:57.128676 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-75617390-70c8-4040-81f5-88ac29c5c475 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Going to try to terminate instance {{(pid=129726) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 08:44:57.201269 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-d1396910-fe22-459c-a119-52592af97fcf tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:57.208873 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-d1396910-fe22-459c-a119-52592af97fcf tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1260 microversion: 2.1 time: 0.187648 Jun 07 08:44:57.209459 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 377/745] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:44:57 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:44:57.481307 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-75617390-70c8-4040-81f5-88ac29c5c475 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971" status: 204 len: 0 microversion: 2.1 time: 0.392952 Jun 07 08:44:57.482228 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 369/746] 10.222.0.17 () {58 vars in 1238 bytes} [Tue Jun 7 08:44:57 2022] DELETE /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 07 08:44:57.490197 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-84f297bc-4b23-44d7-96eb-e950ab2b258f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:57.490842 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-84f297bc-4b23-44d7-96eb-e950ab2b258f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:57.497284 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-84f297bc-4b23-44d7-96eb-e950ab2b258f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:57.497697 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-84f297bc-4b23-44d7-96eb-e950ab2b258f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:57.498466 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-84f297bc-4b23-44d7-96eb-e950ab2b258f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:57.498910 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-84f297bc-4b23-44d7-96eb-e950ab2b258f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:57.638673 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-84f297bc-4b23-44d7-96eb-e950ab2b258f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:57.646381 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-84f297bc-4b23-44d7-96eb-e950ab2b258f tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971" status: 200 len: 1672 microversion: 2.1 time: 0.159989 Jun 07 08:44:57.647817 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 378/747] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:44:57 2022] GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971 => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:44:57.664040 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-f84c4576-571a-41c5-aebd-23043a7bc231 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:57.664766 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-f84c4576-571a-41c5-aebd-23043a7bc231 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:57.670920 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f84c4576-571a-41c5-aebd-23043a7bc231 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:57.671310 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f84c4576-571a-41c5-aebd-23043a7bc231 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:57.672060 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f84c4576-571a-41c5-aebd-23043a7bc231 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:57.672508 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f84c4576-571a-41c5-aebd-23043a7bc231 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:57.774258 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-9595b1b6-82f3-4018-a2b1-09ee774f17d8 req-399942cf-5fdd-4139-8e64-99dac412f2e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb70e18b-43bf-402d-9d70-028908bfc7fd", "name": "network-vif-plugged", "status": "completed", "tag": "c5b234fe-05ce-4bf2-a2ef-1e4c55770be9"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:44:57.784582 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-9595b1b6-82f3-4018-a2b1-09ee774f17d8 req-399942cf-5fdd-4139-8e64-99dac412f2e9 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:57.785165 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-9595b1b6-82f3-4018-a2b1-09ee774f17d8 req-399942cf-5fdd-4139-8e64-99dac412f2e9 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:57.797742 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-9595b1b6-82f3-4018-a2b1-09ee774f17d8 req-399942cf-5fdd-4139-8e64-99dac412f2e9 service nova] Creating event network-vif-plugged:c5b234fe-05ce-4bf2-a2ef-1e4c55770be9 for instance cb70e18b-43bf-402d-9d70-028908bfc7fd on hv-cinder-74014 Jun 07 08:44:57.802967 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-9595b1b6-82f3-4018-a2b1-09ee774f17d8 req-399942cf-5fdd-4139-8e64-99dac412f2e9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032366 Jun 07 08:44:57.805280 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 379/748] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:44:57.820047 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-f84c4576-571a-41c5-aebd-23043a7bc231 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:57.830051 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-f84c4576-571a-41c5-aebd-23043a7bc231 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:57.831592 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-f84c4576-571a-41c5-aebd-23043a7bc231 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:57.832728 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-f84c4576-571a-41c5-aebd-23043a7bc231 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1730 microversion: 2.20 time: 0.172933 Jun 07 08:44:57.833475 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 370/749] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:57 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:58.228743 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-0e338e80-f50b-4879-aa69-494c2d04396c tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:58.229784 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-0e338e80-f50b-4879-aa69-494c2d04396c tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:58.237583 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0e338e80-f50b-4879-aa69-494c2d04396c tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:58.238030 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0e338e80-f50b-4879-aa69-494c2d04396c tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:58.238791 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0e338e80-f50b-4879-aa69-494c2d04396c tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:58.239225 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0e338e80-f50b-4879-aa69-494c2d04396c tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:58.385423 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-0e338e80-f50b-4879-aa69-494c2d04396c tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:58.398340 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-0e338e80-f50b-4879-aa69-494c2d04396c tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1260 microversion: 2.1 time: 0.172286 Jun 07 08:44:58.398340 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 380/750] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:44:58 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:44:58.664327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-7db6c28b-a5d8-4a0b-b0b9-8741401c659b tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:58.664938 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-7db6c28b-a5d8-4a0b-b0b9-8741401c659b tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:58.671958 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7db6c28b-a5d8-4a0b-b0b9-8741401c659b tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:58.672401 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7db6c28b-a5d8-4a0b-b0b9-8741401c659b tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:58.673211 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7db6c28b-a5d8-4a0b-b0b9-8741401c659b tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:58.673648 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-7db6c28b-a5d8-4a0b-b0b9-8741401c659b tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:58.804438 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-7db6c28b-a5d8-4a0b-b0b9-8741401c659b tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:58.812020 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-7db6c28b-a5d8-4a0b-b0b9-8741401c659b tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971" status: 200 len: 1672 microversion: 2.1 time: 0.151524 Jun 07 08:44:58.812583 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 371/751] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:44:58 2022] GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:44:58.850852 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-2da82e3d-ac66-454f-b0ce-1517679d1a3a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:58.851467 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-2da82e3d-ac66-454f-b0ce-1517679d1a3a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:58.858087 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2da82e3d-ac66-454f-b0ce-1517679d1a3a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:58.858539 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2da82e3d-ac66-454f-b0ce-1517679d1a3a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:58.859299 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2da82e3d-ac66-454f-b0ce-1517679d1a3a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:58.859787 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2da82e3d-ac66-454f-b0ce-1517679d1a3a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:58.997189 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-2da82e3d-ac66-454f-b0ce-1517679d1a3a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:59.010182 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-2da82e3d-ac66-454f-b0ce-1517679d1a3a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:59.010182 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-2da82e3d-ac66-454f-b0ce-1517679d1a3a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:59.010182 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-2da82e3d-ac66-454f-b0ce-1517679d1a3a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1730 microversion: 2.20 time: 0.162031 Jun 07 08:44:59.010539 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 381/752] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:44:58 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:44:59.413424 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-20c51c9e-0474-4300-b9be-9e4f4adb52aa tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:59.414000 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-20c51c9e-0474-4300-b9be-9e4f4adb52aa tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:59.420022 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-20c51c9e-0474-4300-b9be-9e4f4adb52aa tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:59.420467 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-20c51c9e-0474-4300-b9be-9e4f4adb52aa tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:59.421245 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-20c51c9e-0474-4300-b9be-9e4f4adb52aa tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:59.421676 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-20c51c9e-0474-4300-b9be-9e4f4adb52aa tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:59.560410 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-20c51c9e-0474-4300-b9be-9e4f4adb52aa tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:44:59.568156 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-20c51c9e-0474-4300-b9be-9e4f4adb52aa tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1260 microversion: 2.1 time: 0.158918 Jun 07 08:44:59.568793 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 372/753] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:44:59 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:44:59.650154 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-1a832bd3-1bca-4820-abd1-63cb6abf5069 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-786462953", "imageRef": "c04b0a92-7675-47c3-bcc2-8a2a59b997c3", "flavorRef": "452"}} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:44:59.707776 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.network.neutron [None req-1a832bd3-1bca-4820-abd1-63cb6abf5069 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] validate_networks() for None {{(pid=129725) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 08:44:59.829467 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-612284c8-ee37-461d-ac2d-d2238886d3c2 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:44:59.830047 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-612284c8-ee37-461d-ac2d-d2238886d3c2 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:44:59.836970 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-612284c8-ee37-461d-ac2d-d2238886d3c2 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:59.837586 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-612284c8-ee37-461d-ac2d-d2238886d3c2 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:44:59.838352 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-612284c8-ee37-461d-ac2d-d2238886d3c2 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:44:59.838784 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-612284c8-ee37-461d-ac2d-d2238886d3c2 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:00.000918 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-612284c8-ee37-461d-ac2d-d2238886d3c2 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:00.003466 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:45:00.009406 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-612284c8-ee37-461d-ac2d-d2238886d3c2 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971" status: 200 len: 1672 microversion: 2.1 time: 0.183932 Jun 07 08:45:00.009972 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 373/754] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:44:59 2022] GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971 => generated 1672 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:45:00.027542 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-bdb92cb2-05d0-48d0-8510-d82e4dd83286 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:00.028198 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-bdb92cb2-05d0-48d0-8510-d82e4dd83286 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:00.034683 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-bdb92cb2-05d0-48d0-8510-d82e4dd83286 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:00.038701 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-bdb92cb2-05d0-48d0-8510-d82e4dd83286 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:00.038701 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-bdb92cb2-05d0-48d0-8510-d82e4dd83286 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:00.038701 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-bdb92cb2-05d0-48d0-8510-d82e4dd83286 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:00.178177 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-bdb92cb2-05d0-48d0-8510-d82e4dd83286 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:00.191021 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-bdb92cb2-05d0-48d0-8510-d82e4dd83286 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:00.193244 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-bdb92cb2-05d0-48d0-8510-d82e4dd83286 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:00.195941 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-bdb92cb2-05d0-48d0-8510-d82e4dd83286 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1730 microversion: 2.20 time: 0.172136 Jun 07 08:45:00.196851 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 374/755] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:45:00 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:45:00.219944 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-1a832bd3-1bca-4820-abd1-63cb6abf5069 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Flavor limits 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 08:45:00.220417 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-1a832bd3-1bca-4820-abd1-63cb6abf5069 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Image limits 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 08:45:00.220989 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-1a832bd3-1bca-4820-abd1-63cb6abf5069 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Flavor pref 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 08:45:00.221532 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-1a832bd3-1bca-4820-abd1-63cb6abf5069 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Image pref 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 08:45:00.222019 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-1a832bd3-1bca-4820-abd1-63cb6abf5069 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 08:45:00.231676 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1a832bd3-1bca-4820-abd1-63cb6abf5069 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:00.232212 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1a832bd3-1bca-4820-abd1-63cb6abf5069 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:00.233114 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1a832bd3-1bca-4820-abd1-63cb6abf5069 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:00.233620 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1a832bd3-1bca-4820-abd1-63cb6abf5069 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:00.251266 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.quota [None req-1a832bd3-1bca-4820-abd1-63cb6abf5069 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Getting quotas for project ec5703dfcb5e4ff8826addb6ca478e51. Resources: {'ram', 'cores', 'instances'} {{(pid=129725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 08:45:00.255598 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.quota [None req-1a832bd3-1bca-4820-abd1-63cb6abf5069 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Getting quotas for user 895951de660840628ca5ec61d4f311cc and project ec5703dfcb5e4ff8826addb6ca478e51. Resources: {'ram', 'cores', 'instances'} {{(pid=129725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 08:45:00.267415 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-1a832bd3-1bca-4820-abd1-63cb6abf5069 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Going to run 1 instances... {{(pid=129725) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 08:45:00.270002 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-1a832bd3-1bca-4820-abd1-63cb6abf5069 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] [instance: 25c308d5-2bdd-4ca1-86f2-302d65154eb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c04b0a92-7675-47c3-bcc2-8a2a59b997c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 08:45:00.374444 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-1a832bd3-1bca-4820-abd1-63cb6abf5069 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.728339 Jun 07 08:45:00.375285 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 382/756] 10.222.0.17 () {60 vars in 1146 bytes} [Tue Jun 7 08:44:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 08:45:00.385354 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-de036420-f744-4ca5-b2ce-a896b063318a tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:00.385969 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-de036420-f744-4ca5-b2ce-a896b063318a tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] [instance: 25c308d5-2bdd-4ca1-86f2-302d65154eb9] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:00.444684 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-de036420-f744-4ca5-b2ce-a896b063318a tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895951de660840628ca5ec61d4f311cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5703dfcb5e4ff8826addb6ca478e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:00.452604 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-de036420-f744-4ca5-b2ce-a896b063318a tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] 10.222.0.17 "GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9" status: 200 len: 1214 microversion: 2.1 time: 0.071402 Jun 07 08:45:00.462301 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 375/757] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:00 2022] GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:45:00.585661 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-34a7a209-100e-4f80-90b5-4fd9c7566ec1 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:00.586276 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-34a7a209-100e-4f80-90b5-4fd9c7566ec1 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:00.593741 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-34a7a209-100e-4f80-90b5-4fd9c7566ec1 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:00.594200 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-34a7a209-100e-4f80-90b5-4fd9c7566ec1 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:00.594968 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-34a7a209-100e-4f80-90b5-4fd9c7566ec1 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:00.595410 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-34a7a209-100e-4f80-90b5-4fd9c7566ec1 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:00.832641 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-34a7a209-100e-4f80-90b5-4fd9c7566ec1 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:00.840297 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-34a7a209-100e-4f80-90b5-4fd9c7566ec1 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1260 microversion: 2.1 time: 0.258479 Jun 07 08:45:00.840874 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 383/758] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:00 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1260 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:45:01.025136 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-d8ddd99e-f649-4dd4-8c5f-6f678a78a5b1 req-a58a921e-167d-4876-a0e0-ee1f5a74e54d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7de79795-1332-477d-a70a-f1e87b662971", "name": "network-vif-deleted", "tag": "096b6e40-1995-4715-a8ed-f4a9214a3135"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:45:01.027454 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-65b8cc1c-577d-4ebd-b59e-862400e17143 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:01.028188 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-65b8cc1c-577d-4ebd-b59e-862400e17143 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:01.041841 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-d8ddd99e-f649-4dd4-8c5f-6f678a78a5b1 req-a58a921e-167d-4876-a0e0-ee1f5a74e54d service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:01.042289 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-d8ddd99e-f649-4dd4-8c5f-6f678a78a5b1 req-a58a921e-167d-4876-a0e0-ee1f5a74e54d service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:01.046801 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-65b8cc1c-577d-4ebd-b59e-862400e17143 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:01.051840 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-65b8cc1c-577d-4ebd-b59e-862400e17143 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:01.058322 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-65b8cc1c-577d-4ebd-b59e-862400e17143 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:01.059659 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-d8ddd99e-f649-4dd4-8c5f-6f678a78a5b1 req-a58a921e-167d-4876-a0e0-ee1f5a74e54d service nova] Creating event network-vif-deleted:096b6e40-1995-4715-a8ed-f4a9214a3135 for instance 7de79795-1332-477d-a70a-f1e87b662971 on hv-cinder-74014 Jun 07 08:45:01.059957 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-65b8cc1c-577d-4ebd-b59e-862400e17143 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:01.065292 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-d8ddd99e-f649-4dd4-8c5f-6f678a78a5b1 req-a58a921e-167d-4876-a0e0-ee1f5a74e54d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048887 Jun 07 08:45:01.070742 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 376/759] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:45:01.136780 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-65b8cc1c-577d-4ebd-b59e-862400e17143 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:01.156785 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-65b8cc1c-577d-4ebd-b59e-862400e17143 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971" status: 200 len: 1606 microversion: 2.1 time: 0.133418 Jun 07 08:45:01.169579 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 384/760] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:01 2022] GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971 => generated 1606 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:45:01.217178 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-a78b4859-a584-4d49-9669-44a2e68e8ada tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:01.217530 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-a78b4859-a584-4d49-9669-44a2e68e8ada tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:01.226718 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a78b4859-a584-4d49-9669-44a2e68e8ada tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:01.227469 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a78b4859-a584-4d49-9669-44a2e68e8ada tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:01.228503 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a78b4859-a584-4d49-9669-44a2e68e8ada tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:01.229171 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a78b4859-a584-4d49-9669-44a2e68e8ada tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:01.366567 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-a78b4859-a584-4d49-9669-44a2e68e8ada tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:01.375165 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-a78b4859-a584-4d49-9669-44a2e68e8ada tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:01.377321 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-a78b4859-a584-4d49-9669-44a2e68e8ada tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:01.377907 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-a78b4859-a584-4d49-9669-44a2e68e8ada tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1717 microversion: 2.20 time: 0.165895 Jun 07 08:45:01.378463 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 377/761] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:45:01 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1717 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:45:01.470639 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-1da5cf14-8eec-4650-b861-9b4fe5a42010 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:01.471256 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-1da5cf14-8eec-4650-b861-9b4fe5a42010 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] [instance: 25c308d5-2bdd-4ca1-86f2-302d65154eb9] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:01.524486 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-1da5cf14-8eec-4650-b861-9b4fe5a42010 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895951de660840628ca5ec61d4f311cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5703dfcb5e4ff8826addb6ca478e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:01.531416 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-1da5cf14-8eec-4650-b861-9b4fe5a42010 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] 10.222.0.17 "GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9" status: 200 len: 1214 microversion: 2.1 time: 0.065181 Jun 07 08:45:01.535663 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 385/762] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:01 2022] GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:45:01.857284 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-1bb6bf74-9580-4eac-bdde-5cbecfff72a9 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:01.858040 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-1bb6bf74-9580-4eac-bdde-5cbecfff72a9 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:01.864480 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1bb6bf74-9580-4eac-bdde-5cbecfff72a9 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:01.864929 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1bb6bf74-9580-4eac-bdde-5cbecfff72a9 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:01.870277 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1bb6bf74-9580-4eac-bdde-5cbecfff72a9 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:01.870277 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1bb6bf74-9580-4eac-bdde-5cbecfff72a9 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:02.002270 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-1bb6bf74-9580-4eac-bdde-5cbecfff72a9 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:02.010886 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-1bb6bf74-9580-4eac-bdde-5cbecfff72a9 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1444 microversion: 2.1 time: 0.157679 Jun 07 08:45:02.022612 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 378/763] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:01 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1444 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:45:02.029451 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-c43b5ac3-ef5d-4c28-a3b9-492354e21bf7 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:02.030054 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-c43b5ac3-ef5d-4c28-a3b9-492354e21bf7 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:02.037043 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c43b5ac3-ef5d-4c28-a3b9-492354e21bf7 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:02.037753 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c43b5ac3-ef5d-4c28-a3b9-492354e21bf7 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:02.039171 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c43b5ac3-ef5d-4c28-a3b9-492354e21bf7 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:02.039171 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c43b5ac3-ef5d-4c28-a3b9-492354e21bf7 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:02.173458 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-c43b5ac3-ef5d-4c28-a3b9-492354e21bf7 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:02.181746 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-ed0be232-8981-4b11-a08b-2c791ec19ad7 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:02.182617 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-ed0be232-8981-4b11-a08b-2c791ec19ad7 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:02.187866 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-c43b5ac3-ef5d-4c28-a3b9-492354e21bf7 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1444 microversion: 2.1 time: 0.164334 Jun 07 08:45:02.197158 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 386/764] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:02 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1444 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:45:02.207562 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ed0be232-8981-4b11-a08b-2c791ec19ad7 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:02.211102 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ed0be232-8981-4b11-a08b-2c791ec19ad7 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:02.214060 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ed0be232-8981-4b11-a08b-2c791ec19ad7 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:02.214538 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ed0be232-8981-4b11-a08b-2c791ec19ad7 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:02.250530 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ed0be232-8981-4b11-a08b-2c791ec19ad7 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:02.251279 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ed0be232-8981-4b11-a08b-2c791ec19ad7 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:02.251867 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.objects.instance [None req-ed0be232-8981-4b11-a08b-2c791ec19ad7 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lazy-loading 'fault' on Instance uuid 7de79795-1332-477d-a70a-f1e87b662971 {{(pid=129726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:45:02.298423 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-ed0be232-8981-4b11-a08b-2c791ec19ad7 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5893f0909446ff82b5a72584ecae37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5daf862eb4de4ea992b35692f003a25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:02.306623 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-ed0be232-8981-4b11-a08b-2c791ec19ad7 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971" status: 200 len: 1328 microversion: 2.1 time: 0.128651 Jun 07 08:45:02.307207 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 379/765] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:02 2022] GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971 => generated 1328 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:45:02.549628 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-551e6000-7141-4a48-9f70-cb8058fa55ad tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:02.550160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-551e6000-7141-4a48-9f70-cb8058fa55ad tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] [instance: 25c308d5-2bdd-4ca1-86f2-302d65154eb9] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:02.556149 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-551e6000-7141-4a48-9f70-cb8058fa55ad tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:02.556596 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-551e6000-7141-4a48-9f70-cb8058fa55ad tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:02.557388 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-551e6000-7141-4a48-9f70-cb8058fa55ad tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:02.557820 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-551e6000-7141-4a48-9f70-cb8058fa55ad tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:02.624719 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-551e6000-7141-4a48-9f70-cb8058fa55ad tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895951de660840628ca5ec61d4f311cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5703dfcb5e4ff8826addb6ca478e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:02.632833 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-551e6000-7141-4a48-9f70-cb8058fa55ad tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] 10.222.0.17 "GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9" status: 200 len: 1266 microversion: 2.1 time: 0.087228 Jun 07 08:45:02.639990 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 387/766] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:02 2022] GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:45:03.324261 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-e2e01e2e-0ae1-431b-9f47-4d62e056c234 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:03.325631 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-e2e01e2e-0ae1-431b-9f47-4d62e056c234 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:03.333183 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e2e01e2e-0ae1-431b-9f47-4d62e056c234 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:03.333929 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e2e01e2e-0ae1-431b-9f47-4d62e056c234 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:03.334927 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e2e01e2e-0ae1-431b-9f47-4d62e056c234 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:03.335680 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e2e01e2e-0ae1-431b-9f47-4d62e056c234 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:03.351834 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.wsgi [None req-e2e01e2e-0ae1-431b-9f47-4d62e056c234 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] HTTP exception thrown: Instance 7de79795-1332-477d-a70a-f1e87b662971 could not be found. Jun 07 08:45:03.355007 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-e2e01e2e-0ae1-431b-9f47-4d62e056c234 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Request method failure captured: Jun 07 08:45:03.355007 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: request: GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971 HTTP/1.1 Jun 07 08:45:03.355007 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept: application/json Jun 07 08:45:03.355007 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept-Encoding: identity Jun 07 08:45:03.355007 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Connection: close Jun 07 08:45:03.355007 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Length: 0 Jun 07 08:45:03.355007 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Type: application/json Jun 07 08:45:03.355007 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Host: 10.222.0.17 Jun 07 08:45:03.355007 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Openstack-System-Scope: None Jun 07 08:45:03.355007 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: User-Agent: python-urllib3/1.26.9 Jun 07 08:45:03.355007 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Auth-Token: gAAAAABinw6-7el6TUaqlSfN6ox6uip34y8etluDfGlaTvausajvfgvls2A0jjAYCLH5pC2itfXzYgt0jZueYHUX00suhcuAIAy6nVtlE5ArpM_LsQjOZCWM2paJeDTt2dg8brNA5YPORh5W6IjC4hRH--5OrwOOBsIAsxbPHTDmHpCTKZg9-Cg Jun 07 08:45:03.355007 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Id: None Jun 07 08:45:03.355007 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Name: None Jun 07 08:45:03.355007 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Identity-Status: Confirmed Jun 07 08:45:03.355007 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Is-Admin-Project: True Jun 07 08:45:03.355007 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Id: default Jun 07 08:45:03.355007 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Name: Default Jun 07 08:45:03.355007 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Id: 5daf862eb4de4ea992b35692f003a25e Jun 07 08:45:03.355007 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Name: tempest-AttachVolumeTestJSON-888820175 Jun 07 08:45:03.355007 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Role: reader,member Jun 07 08:45:03.355007 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Roles: reader,member Jun 07 08:45:03.357111 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5daf862eb4de4ea992b35692f003a25e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5daf862eb4de4ea992b35692f003a25e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5daf862eb4de4ea992b35692f003a25e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5daf862eb4de4ea992b35692f003a25e"}]}] Jun 07 08:45:03.357111 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant: tempest-AttachVolumeTestJSON-888820175 Jun 07 08:45:03.357111 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Id: 5daf862eb4de4ea992b35692f003a25e Jun 07 08:45:03.357111 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Name: tempest-AttachVolumeTestJSON-888820175 Jun 07 08:45:03.357111 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User: tempest-AttachVolumeTestJSON-888820175-project Jun 07 08:45:03.357111 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Id: default Jun 07 08:45:03.357111 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Name: Default Jun 07 08:45:03.357111 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Id: 4e5893f0909446ff82b5a72584ecae37 Jun 07 08:45:03.357111 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Name: tempest-AttachVolumeTestJSON-888820175-project Jun 07 08:45:03.357111 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: method: > Jun 07 08:45:03.357111 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: exception: Instance 7de79795-1332-477d-a70a-f1e87b662971 could not be found. Jun 07 08:45:03.357111 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: action_args: {'id': '7de79795-1332-477d-a70a-f1e87b662971'} Jun 07 08:45:03.361554 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:45:03.361554 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:45:03.361554 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:45:03.361554 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:45:03.361554 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:45:03.361554 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:45:03.361554 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:45:03.361554 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:45:03.361554 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:45:03.361554 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:45:03.361554 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7de79795-1332-477d-a70a-f1e87b662971 could not be found. Jun 07 08:45:03.361554 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:03.361554 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:45:03.361554 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:03.361554 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:45:03.361554 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:45:03.361554 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:45:03.361554 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:45:03.361554 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:45:03.361554 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:45:03.363106 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:45:03.363106 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 08:45:03.363106 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 08:45:03.363106 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:45:03.363106 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:45:03.363106 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:45:03.363106 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:45:03.363106 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7de79795-1332-477d-a70a-f1e87b662971 could not be found. Jun 07 08:45:03.363106 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:03.363106 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:45:03.363106 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:03.363106 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:45:03.363106 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:45:03.363106 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:45:03.363106 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:45:03.363106 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:45:03.363106 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7de79795-1332-477d-a70a-f1e87b662971 could not be found. Jun 07 08:45:03.363106 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:03.364450 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-e2e01e2e-0ae1-431b-9f47-4d62e056c234 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Returning 404 to user: Instance 7de79795-1332-477d-a70a-f1e87b662971 could not be found. {{(pid=129726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:45:03.364450 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-e2e01e2e-0ae1-431b-9f47-4d62e056c234 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971" status: 404 len: 111 microversion: 2.1 time: 0.035240 Jun 07 08:45:03.364450 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 380/767] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:03 2022] GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:45:03.367378 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-c6a02dd4-cee4-48fd-8f1b-988bd7c5928e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '.version_select at 0x7f7fed294f70>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:03.460759 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-c6a02dd4-cee4-48fd-8f1b-988bd7c5928e tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1010843116" status: 202 len: 0 microversion: 2.1 time: 0.098784 Jun 07 08:45:03.461803 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 388/768] 10.222.0.17 () {58 vars in 1220 bytes} [Tue Jun 7 08:45:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1010843116 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 08:45:03.650076 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-34539ffc-1b70-4b1a-b38c-a521e30af8b8 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:03.650687 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-34539ffc-1b70-4b1a-b38c-a521e30af8b8 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] [instance: 25c308d5-2bdd-4ca1-86f2-302d65154eb9] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:03.657560 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-34539ffc-1b70-4b1a-b38c-a521e30af8b8 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:03.658004 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-34539ffc-1b70-4b1a-b38c-a521e30af8b8 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:03.658764 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-34539ffc-1b70-4b1a-b38c-a521e30af8b8 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:03.659204 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-34539ffc-1b70-4b1a-b38c-a521e30af8b8 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:03.738567 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-34539ffc-1b70-4b1a-b38c-a521e30af8b8 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895951de660840628ca5ec61d4f311cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5703dfcb5e4ff8826addb6ca478e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:03.747225 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-34539ffc-1b70-4b1a-b38c-a521e30af8b8 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] 10.222.0.17 "GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9" status: 200 len: 1272 microversion: 2.1 time: 0.101116 Jun 07 08:45:03.747795 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 381/769] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:03 2022] GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9 => generated 1272 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:45:04.666338 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-ec8a3d11-f8cf-4d2f-977d-81ce62e521c3 req-ff3a8fa3-d264-4aa4-9819-26086f39dcd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb70e18b-43bf-402d-9d70-028908bfc7fd", "tag": "c5b234fe-05ce-4bf2-a2ef-1e4c55770be9"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:45:04.679018 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-ec8a3d11-f8cf-4d2f-977d-81ce62e521c3 req-ff3a8fa3-d264-4aa4-9819-26086f39dcd9 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:04.679870 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-ec8a3d11-f8cf-4d2f-977d-81ce62e521c3 req-ff3a8fa3-d264-4aa4-9819-26086f39dcd9 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:04.691934 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-ec8a3d11-f8cf-4d2f-977d-81ce62e521c3 req-ff3a8fa3-d264-4aa4-9819-26086f39dcd9 service nova] Creating event network-changed:c5b234fe-05ce-4bf2-a2ef-1e4c55770be9 for instance cb70e18b-43bf-402d-9d70-028908bfc7fd on hv-cinder-74014 Jun 07 08:45:04.697358 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-ec8a3d11-f8cf-4d2f-977d-81ce62e521c3 req-ff3a8fa3-d264-4aa4-9819-26086f39dcd9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036211 Jun 07 08:45:04.698643 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 389/770] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:45:04.769267 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-e793ad9c-d0ae-4e88-b500-d1a72b1ea80b tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:04.769881 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-e793ad9c-d0ae-4e88-b500-d1a72b1ea80b tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] [instance: 25c308d5-2bdd-4ca1-86f2-302d65154eb9] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:04.777553 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e793ad9c-d0ae-4e88-b500-d1a72b1ea80b tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:04.778543 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e793ad9c-d0ae-4e88-b500-d1a72b1ea80b tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:04.779938 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e793ad9c-d0ae-4e88-b500-d1a72b1ea80b tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:04.780590 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e793ad9c-d0ae-4e88-b500-d1a72b1ea80b tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:04.922153 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-e793ad9c-d0ae-4e88-b500-d1a72b1ea80b tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895951de660840628ca5ec61d4f311cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5703dfcb5e4ff8826addb6ca478e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:04.929943 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-e793ad9c-d0ae-4e88-b500-d1a72b1ea80b tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] 10.222.0.17 "GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9" status: 200 len: 1314 microversion: 2.1 time: 0.164747 Jun 07 08:45:04.931015 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 382/771] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:04 2022] GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:45:05.781946 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-5bf239c8-4f6d-4604-b990-56f265d70fd1 req-8a12af5e-b053-42c9-9e29-f34aadc7d2f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25c308d5-2bdd-4ca1-86f2-302d65154eb9", "tag": "dca0d3e5-0728-4b5e-9658-d3963ab570bc"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:45:05.792408 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-5bf239c8-4f6d-4604-b990-56f265d70fd1 req-8a12af5e-b053-42c9-9e29-f34aadc7d2f2 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:05.792872 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-5bf239c8-4f6d-4604-b990-56f265d70fd1 req-8a12af5e-b053-42c9-9e29-f34aadc7d2f2 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:05.805484 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-5bf239c8-4f6d-4604-b990-56f265d70fd1 req-8a12af5e-b053-42c9-9e29-f34aadc7d2f2 service nova] Creating event network-changed:dca0d3e5-0728-4b5e-9658-d3963ab570bc for instance 25c308d5-2bdd-4ca1-86f2-302d65154eb9 on hv-cinder-74014 Jun 07 08:45:05.811248 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-5bf239c8-4f6d-4604-b990-56f265d70fd1 req-8a12af5e-b053-42c9-9e29-f34aadc7d2f2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036035 Jun 07 08:45:05.812373 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 390/772] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:45:05.949180 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-ba15493a-bb61-40bb-825a-4a464bb061fe tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:05.952187 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-ba15493a-bb61-40bb-825a-4a464bb061fe tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] [instance: 25c308d5-2bdd-4ca1-86f2-302d65154eb9] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:05.957519 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ba15493a-bb61-40bb-825a-4a464bb061fe tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:05.957966 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ba15493a-bb61-40bb-825a-4a464bb061fe tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:05.958723 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ba15493a-bb61-40bb-825a-4a464bb061fe tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:05.959155 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ba15493a-bb61-40bb-825a-4a464bb061fe tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:06.103068 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-ba15493a-bb61-40bb-825a-4a464bb061fe tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895951de660840628ca5ec61d4f311cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5703dfcb5e4ff8826addb6ca478e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:06.111449 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-ba15493a-bb61-40bb-825a-4a464bb061fe tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] 10.222.0.17 "GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9" status: 200 len: 1314 microversion: 2.1 time: 0.167813 Jun 07 08:45:06.112040 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 383/773] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:05 2022] GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:45:07.129374 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-2ba82964-a838-4228-95b0-af421ceb765b tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:07.130082 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-2ba82964-a838-4228-95b0-af421ceb765b tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] [instance: 25c308d5-2bdd-4ca1-86f2-302d65154eb9] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:07.136289 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2ba82964-a838-4228-95b0-af421ceb765b tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:07.136743 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2ba82964-a838-4228-95b0-af421ceb765b tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:07.138175 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2ba82964-a838-4228-95b0-af421ceb765b tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:07.138639 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2ba82964-a838-4228-95b0-af421ceb765b tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:07.273027 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-2ba82964-a838-4228-95b0-af421ceb765b tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895951de660840628ca5ec61d4f311cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5703dfcb5e4ff8826addb6ca478e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:07.280849 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-2ba82964-a838-4228-95b0-af421ceb765b tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] 10.222.0.17 "GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9" status: 200 len: 1314 microversion: 2.1 time: 0.156317 Jun 07 08:45:07.281448 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 391/774] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:07 2022] GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:45:07.706775 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-81588596-f132-4f4c-9d98-feeb48f0e337 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:07.707280 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-81588596-f132-4f4c-9d98-feeb48f0e337 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:07.713809 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-81588596-f132-4f4c-9d98-feeb48f0e337 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:07.714260 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-81588596-f132-4f4c-9d98-feeb48f0e337 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:07.715023 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-81588596-f132-4f4c-9d98-feeb48f0e337 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:07.715577 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-81588596-f132-4f4c-9d98-feeb48f0e337 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:07.730126 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.wsgi [None req-81588596-f132-4f4c-9d98-feeb48f0e337 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] HTTP exception thrown: Instance 7de79795-1332-477d-a70a-f1e87b662971 could not be found. Jun 07 08:45:07.731642 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-81588596-f132-4f4c-9d98-feeb48f0e337 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Request method failure captured: Jun 07 08:45:07.731642 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: request: DELETE /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971 HTTP/1.1 Jun 07 08:45:07.731642 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept: application/json Jun 07 08:45:07.731642 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept-Encoding: identity Jun 07 08:45:07.731642 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Connection: close Jun 07 08:45:07.731642 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Length: 0 Jun 07 08:45:07.731642 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Type: application/json Jun 07 08:45:07.731642 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Host: 10.222.0.17 Jun 07 08:45:07.731642 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Openstack-System-Scope: None Jun 07 08:45:07.731642 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: User-Agent: python-urllib3/1.26.9 Jun 07 08:45:07.731642 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Auth-Token: gAAAAABinw6-7el6TUaqlSfN6ox6uip34y8etluDfGlaTvausajvfgvls2A0jjAYCLH5pC2itfXzYgt0jZueYHUX00suhcuAIAy6nVtlE5ArpM_LsQjOZCWM2paJeDTt2dg8brNA5YPORh5W6IjC4hRH--5OrwOOBsIAsxbPHTDmHpCTKZg9-Cg Jun 07 08:45:07.731642 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Id: None Jun 07 08:45:07.731642 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Name: None Jun 07 08:45:07.731642 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Identity-Status: Confirmed Jun 07 08:45:07.731642 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Is-Admin-Project: True Jun 07 08:45:07.731642 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Id: default Jun 07 08:45:07.731642 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Name: Default Jun 07 08:45:07.731642 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Id: 5daf862eb4de4ea992b35692f003a25e Jun 07 08:45:07.731642 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Name: tempest-AttachVolumeTestJSON-888820175 Jun 07 08:45:07.731642 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Role: reader,member Jun 07 08:45:07.731642 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Roles: reader,member Jun 07 08:45:07.733162 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5daf862eb4de4ea992b35692f003a25e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5daf862eb4de4ea992b35692f003a25e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5daf862eb4de4ea992b35692f003a25e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5daf862eb4de4ea992b35692f003a25e"}]}] Jun 07 08:45:07.733162 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant: tempest-AttachVolumeTestJSON-888820175 Jun 07 08:45:07.733162 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Id: 5daf862eb4de4ea992b35692f003a25e Jun 07 08:45:07.733162 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Name: tempest-AttachVolumeTestJSON-888820175 Jun 07 08:45:07.733162 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User: tempest-AttachVolumeTestJSON-888820175-project Jun 07 08:45:07.733162 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Id: default Jun 07 08:45:07.733162 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Name: Default Jun 07 08:45:07.733162 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Id: 4e5893f0909446ff82b5a72584ecae37 Jun 07 08:45:07.733162 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Name: tempest-AttachVolumeTestJSON-888820175-project Jun 07 08:45:07.733162 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: method: > Jun 07 08:45:07.733162 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: exception: Instance 7de79795-1332-477d-a70a-f1e87b662971 could not be found. Jun 07 08:45:07.733162 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: action_args: {'id': '7de79795-1332-477d-a70a-f1e87b662971'} Jun 07 08:45:07.734028 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:45:07.734028 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:45:07.734028 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:45:07.734028 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:45:07.734028 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:45:07.734028 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:45:07.734028 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:45:07.734028 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:45:07.734028 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:45:07.734028 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:45:07.734028 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7de79795-1332-477d-a70a-f1e87b662971 could not be found. Jun 07 08:45:07.734028 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:07.734028 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:45:07.734028 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:07.734028 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:45:07.734028 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:45:07.734028 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:45:07.734028 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:45:07.734028 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:45:07.734028 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:45:07.735327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:45:07.735327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 08:45:07.735327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 08:45:07.735327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 08:45:07.735327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 08:45:07.735327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:45:07.735327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:45:07.735327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:45:07.735327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:45:07.735327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7de79795-1332-477d-a70a-f1e87b662971 could not be found. Jun 07 08:45:07.735327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:07.735327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:45:07.735327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:07.735327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:45:07.735327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:45:07.735327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:45:07.735327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:45:07.735327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:45:07.735327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7de79795-1332-477d-a70a-f1e87b662971 could not be found. Jun 07 08:45:07.735327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:07.736544 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-81588596-f132-4f4c-9d98-feeb48f0e337 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Returning 404 to user: Instance 7de79795-1332-477d-a70a-f1e87b662971 could not be found. {{(pid=129726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:45:07.736544 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-81588596-f132-4f4c-9d98-feeb48f0e337 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971" status: 404 len: 111 microversion: 2.1 time: 0.030068 Jun 07 08:45:07.736544 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 384/775] 10.222.0.17 () {58 vars in 1238 bytes} [Tue Jun 7 08:45:07 2022] DELETE /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:45:07.741315 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-1afc2602-8ae5-4fcf-b61a-68762a458d78 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:07.741934 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-1afc2602-8ae5-4fcf-b61a-68762a458d78 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 7de79795-1332-477d-a70a-f1e87b662971] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:07.748596 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1afc2602-8ae5-4fcf-b61a-68762a458d78 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:07.749066 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1afc2602-8ae5-4fcf-b61a-68762a458d78 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:07.749849 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1afc2602-8ae5-4fcf-b61a-68762a458d78 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:07.750277 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1afc2602-8ae5-4fcf-b61a-68762a458d78 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:07.765541 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.wsgi [None req-1afc2602-8ae5-4fcf-b61a-68762a458d78 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] HTTP exception thrown: Instance 7de79795-1332-477d-a70a-f1e87b662971 could not be found. Jun 07 08:45:07.767168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-1afc2602-8ae5-4fcf-b61a-68762a458d78 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Request method failure captured: Jun 07 08:45:07.767168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: request: GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971 HTTP/1.1 Jun 07 08:45:07.767168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept: application/json Jun 07 08:45:07.767168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept-Encoding: identity Jun 07 08:45:07.767168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Connection: close Jun 07 08:45:07.767168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Length: 0 Jun 07 08:45:07.767168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Type: application/json Jun 07 08:45:07.767168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Host: 10.222.0.17 Jun 07 08:45:07.767168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Openstack-System-Scope: None Jun 07 08:45:07.767168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: User-Agent: python-urllib3/1.26.9 Jun 07 08:45:07.767168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Auth-Token: gAAAAABinw6-7el6TUaqlSfN6ox6uip34y8etluDfGlaTvausajvfgvls2A0jjAYCLH5pC2itfXzYgt0jZueYHUX00suhcuAIAy6nVtlE5ArpM_LsQjOZCWM2paJeDTt2dg8brNA5YPORh5W6IjC4hRH--5OrwOOBsIAsxbPHTDmHpCTKZg9-Cg Jun 07 08:45:07.767168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Id: None Jun 07 08:45:07.767168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Name: None Jun 07 08:45:07.767168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Identity-Status: Confirmed Jun 07 08:45:07.767168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Is-Admin-Project: True Jun 07 08:45:07.767168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Id: default Jun 07 08:45:07.767168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Name: Default Jun 07 08:45:07.767168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Id: 5daf862eb4de4ea992b35692f003a25e Jun 07 08:45:07.767168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Name: tempest-AttachVolumeTestJSON-888820175 Jun 07 08:45:07.767168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Role: reader,member Jun 07 08:45:07.767168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Roles: reader,member Jun 07 08:45:07.768779 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5daf862eb4de4ea992b35692f003a25e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5daf862eb4de4ea992b35692f003a25e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5daf862eb4de4ea992b35692f003a25e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5daf862eb4de4ea992b35692f003a25e"}]}] Jun 07 08:45:07.768779 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant: tempest-AttachVolumeTestJSON-888820175 Jun 07 08:45:07.768779 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Id: 5daf862eb4de4ea992b35692f003a25e Jun 07 08:45:07.768779 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Name: tempest-AttachVolumeTestJSON-888820175 Jun 07 08:45:07.768779 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User: tempest-AttachVolumeTestJSON-888820175-project Jun 07 08:45:07.768779 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Id: default Jun 07 08:45:07.768779 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Name: Default Jun 07 08:45:07.768779 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Id: 4e5893f0909446ff82b5a72584ecae37 Jun 07 08:45:07.768779 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Name: tempest-AttachVolumeTestJSON-888820175-project Jun 07 08:45:07.768779 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: method: > Jun 07 08:45:07.768779 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: exception: Instance 7de79795-1332-477d-a70a-f1e87b662971 could not be found. Jun 07 08:45:07.768779 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: action_args: {'id': '7de79795-1332-477d-a70a-f1e87b662971'} Jun 07 08:45:07.769685 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:45:07.769685 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:45:07.769685 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:45:07.769685 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:45:07.769685 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:45:07.769685 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:45:07.769685 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:45:07.769685 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:45:07.769685 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:45:07.769685 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:45:07.769685 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7de79795-1332-477d-a70a-f1e87b662971 could not be found. Jun 07 08:45:07.769685 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:45:07.769685 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:45:07.769685 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:45:07.769685 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:45:07.769685 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:45:07.769685 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:45:07.769685 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:45:07.769685 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:45:07.769685 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:45:07.771091 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:45:07.771091 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 08:45:07.771091 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 08:45:07.771091 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:45:07.771091 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:45:07.771091 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:45:07.771091 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:45:07.771091 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7de79795-1332-477d-a70a-f1e87b662971 could not be found. Jun 07 08:45:07.771091 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:45:07.771091 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:45:07.771091 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:45:07.771091 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:45:07.771091 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:45:07.771091 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:45:07.771091 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:45:07.771091 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:45:07.771091 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7de79795-1332-477d-a70a-f1e87b662971 could not be found. Jun 07 08:45:07.771091 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:45:07.772355 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-1afc2602-8ae5-4fcf-b61a-68762a458d78 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Returning 404 to user: Instance 7de79795-1332-477d-a70a-f1e87b662971 could not be found. {{(pid=129725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:45:07.772355 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-1afc2602-8ae5-4fcf-b61a-68762a458d78 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971" status: 404 len: 111 microversion: 2.1 time: 0.031079 Jun 07 08:45:07.772355 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 392/776] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:07 2022] GET /compute/v2.1/servers/7de79795-1332-477d-a70a-f1e87b662971 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:45:08.298836 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-77808574-f021-43b3-b6a7-344540b3c18f tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:08.299363 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-77808574-f021-43b3-b6a7-344540b3c18f tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] [instance: 25c308d5-2bdd-4ca1-86f2-302d65154eb9] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:08.305337 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-77808574-f021-43b3-b6a7-344540b3c18f tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:08.310002 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-77808574-f021-43b3-b6a7-344540b3c18f tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:08.310002 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-77808574-f021-43b3-b6a7-344540b3c18f tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:08.310002 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-77808574-f021-43b3-b6a7-344540b3c18f tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:08.436633 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-77808574-f021-43b3-b6a7-344540b3c18f tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895951de660840628ca5ec61d4f311cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5703dfcb5e4ff8826addb6ca478e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:08.444920 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-77808574-f021-43b3-b6a7-344540b3c18f tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] 10.222.0.17 "GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9" status: 200 len: 1314 microversion: 2.1 time: 0.149689 Jun 07 08:45:08.446023 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 385/777] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:08 2022] GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:45:09.033701 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-3af0f5ce-afbf-417a-a101-ed5c042d5bbe tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:09.034224 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-3af0f5ce-afbf-417a-a101-ed5c042d5bbe tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:09.040596 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3af0f5ce-afbf-417a-a101-ed5c042d5bbe tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:09.041069 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3af0f5ce-afbf-417a-a101-ed5c042d5bbe tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:09.041829 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3af0f5ce-afbf-417a-a101-ed5c042d5bbe tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:09.042293 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3af0f5ce-afbf-417a-a101-ed5c042d5bbe tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:09.055528 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.wsgi [None req-3af0f5ce-afbf-417a-a101-ed5c042d5bbe tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] HTTP exception thrown: Instance 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 could not be found. Jun 07 08:45:09.057089 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-3af0f5ce-afbf-417a-a101-ed5c042d5bbe tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Request method failure captured: Jun 07 08:45:09.057089 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: request: DELETE /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 HTTP/1.1 Jun 07 08:45:09.057089 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept: application/json Jun 07 08:45:09.057089 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept-Encoding: identity Jun 07 08:45:09.057089 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Connection: close Jun 07 08:45:09.057089 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Length: 0 Jun 07 08:45:09.057089 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Type: application/json Jun 07 08:45:09.057089 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Host: 10.222.0.17 Jun 07 08:45:09.057089 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Openstack-System-Scope: None Jun 07 08:45:09.057089 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: User-Agent: python-urllib3/1.26.9 Jun 07 08:45:09.057089 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Auth-Token: gAAAAABinw6-7el6TUaqlSfN6ox6uip34y8etluDfGlaTvausajvfgvls2A0jjAYCLH5pC2itfXzYgt0jZueYHUX00suhcuAIAy6nVtlE5ArpM_LsQjOZCWM2paJeDTt2dg8brNA5YPORh5W6IjC4hRH--5OrwOOBsIAsxbPHTDmHpCTKZg9-Cg Jun 07 08:45:09.057089 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Id: None Jun 07 08:45:09.057089 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Name: None Jun 07 08:45:09.057089 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Identity-Status: Confirmed Jun 07 08:45:09.057089 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Is-Admin-Project: True Jun 07 08:45:09.057089 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Id: default Jun 07 08:45:09.057089 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Name: Default Jun 07 08:45:09.057089 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Id: 5daf862eb4de4ea992b35692f003a25e Jun 07 08:45:09.057089 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Name: tempest-AttachVolumeTestJSON-888820175 Jun 07 08:45:09.057089 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Role: reader,member Jun 07 08:45:09.057089 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Roles: reader,member Jun 07 08:45:09.058627 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5daf862eb4de4ea992b35692f003a25e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5daf862eb4de4ea992b35692f003a25e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5daf862eb4de4ea992b35692f003a25e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5daf862eb4de4ea992b35692f003a25e"}]}] Jun 07 08:45:09.058627 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant: tempest-AttachVolumeTestJSON-888820175 Jun 07 08:45:09.058627 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Id: 5daf862eb4de4ea992b35692f003a25e Jun 07 08:45:09.058627 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Name: tempest-AttachVolumeTestJSON-888820175 Jun 07 08:45:09.058627 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User: tempest-AttachVolumeTestJSON-888820175-project Jun 07 08:45:09.058627 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Id: default Jun 07 08:45:09.058627 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Name: Default Jun 07 08:45:09.058627 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Id: 4e5893f0909446ff82b5a72584ecae37 Jun 07 08:45:09.058627 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Name: tempest-AttachVolumeTestJSON-888820175-project Jun 07 08:45:09.058627 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: method: > Jun 07 08:45:09.058627 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: exception: Instance 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 could not be found. Jun 07 08:45:09.058627 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: action_args: {'id': '9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7'} Jun 07 08:45:09.060451 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:45:09.060451 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:45:09.060451 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:45:09.060451 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:45:09.060451 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:45:09.060451 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:45:09.060451 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:45:09.060451 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:45:09.060451 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:45:09.060451 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:45:09.060451 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 could not be found. Jun 07 08:45:09.060451 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:45:09.060451 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:45:09.060451 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:45:09.060451 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:45:09.060451 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:45:09.060451 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:45:09.060451 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:45:09.060451 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:45:09.060451 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:45:09.062957 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:45:09.062957 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 08:45:09.062957 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 08:45:09.062957 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 08:45:09.062957 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 08:45:09.062957 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:45:09.062957 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:45:09.062957 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:45:09.062957 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:45:09.062957 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 could not be found. Jun 07 08:45:09.062957 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:45:09.062957 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:45:09.062957 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:45:09.062957 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:45:09.062957 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:45:09.062957 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:45:09.062957 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:45:09.062957 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:45:09.062957 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 could not be found. Jun 07 08:45:09.062957 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:45:09.064375 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-3af0f5ce-afbf-417a-a101-ed5c042d5bbe tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Returning 404 to user: Instance 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 could not be found. {{(pid=129725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:45:09.064375 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-3af0f5ce-afbf-417a-a101-ed5c042d5bbe tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 404 len: 111 microversion: 2.1 time: 0.028606 Jun 07 08:45:09.064375 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 393/778] 10.222.0.17 () {58 vars in 1238 bytes} [Tue Jun 7 08:45:09 2022] DELETE /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:45:09.067813 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-0d7640f8-ff4a-4632-a5cd-dfdd26808065 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:09.068479 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-0d7640f8-ff4a-4632-a5cd-dfdd26808065 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] [instance: 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:09.075874 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0d7640f8-ff4a-4632-a5cd-dfdd26808065 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:09.076318 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0d7640f8-ff4a-4632-a5cd-dfdd26808065 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:09.077262 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0d7640f8-ff4a-4632-a5cd-dfdd26808065 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:09.077808 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0d7640f8-ff4a-4632-a5cd-dfdd26808065 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:09.091129 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.wsgi [None req-0d7640f8-ff4a-4632-a5cd-dfdd26808065 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] HTTP exception thrown: Instance 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 could not be found. Jun 07 08:45:09.092612 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-0d7640f8-ff4a-4632-a5cd-dfdd26808065 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Request method failure captured: Jun 07 08:45:09.092612 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: request: GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 HTTP/1.1 Jun 07 08:45:09.092612 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept: application/json Jun 07 08:45:09.092612 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept-Encoding: identity Jun 07 08:45:09.092612 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Connection: close Jun 07 08:45:09.092612 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Length: 0 Jun 07 08:45:09.092612 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Type: application/json Jun 07 08:45:09.092612 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Host: 10.222.0.17 Jun 07 08:45:09.092612 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Openstack-System-Scope: None Jun 07 08:45:09.092612 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: User-Agent: python-urllib3/1.26.9 Jun 07 08:45:09.092612 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Auth-Token: gAAAAABinw6-7el6TUaqlSfN6ox6uip34y8etluDfGlaTvausajvfgvls2A0jjAYCLH5pC2itfXzYgt0jZueYHUX00suhcuAIAy6nVtlE5ArpM_LsQjOZCWM2paJeDTt2dg8brNA5YPORh5W6IjC4hRH--5OrwOOBsIAsxbPHTDmHpCTKZg9-Cg Jun 07 08:45:09.092612 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Id: None Jun 07 08:45:09.092612 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Name: None Jun 07 08:45:09.092612 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Identity-Status: Confirmed Jun 07 08:45:09.092612 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Is-Admin-Project: True Jun 07 08:45:09.092612 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Id: default Jun 07 08:45:09.092612 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Name: Default Jun 07 08:45:09.092612 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Id: 5daf862eb4de4ea992b35692f003a25e Jun 07 08:45:09.092612 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Name: tempest-AttachVolumeTestJSON-888820175 Jun 07 08:45:09.092612 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Role: reader,member Jun 07 08:45:09.092612 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Roles: reader,member Jun 07 08:45:09.094277 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5daf862eb4de4ea992b35692f003a25e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5daf862eb4de4ea992b35692f003a25e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5daf862eb4de4ea992b35692f003a25e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5daf862eb4de4ea992b35692f003a25e"}]}] Jun 07 08:45:09.094277 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant: tempest-AttachVolumeTestJSON-888820175 Jun 07 08:45:09.094277 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Id: 5daf862eb4de4ea992b35692f003a25e Jun 07 08:45:09.094277 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Name: tempest-AttachVolumeTestJSON-888820175 Jun 07 08:45:09.094277 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User: tempest-AttachVolumeTestJSON-888820175-project Jun 07 08:45:09.094277 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Id: default Jun 07 08:45:09.094277 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Name: Default Jun 07 08:45:09.094277 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Id: 4e5893f0909446ff82b5a72584ecae37 Jun 07 08:45:09.094277 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Name: tempest-AttachVolumeTestJSON-888820175-project Jun 07 08:45:09.094277 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: method: > Jun 07 08:45:09.094277 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: exception: Instance 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 could not be found. Jun 07 08:45:09.094277 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: action_args: {'id': '9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7'} Jun 07 08:45:09.095211 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:45:09.095211 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:45:09.095211 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:45:09.095211 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:45:09.095211 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:45:09.095211 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:45:09.095211 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:45:09.095211 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:45:09.095211 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:45:09.095211 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:45:09.095211 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 could not be found. Jun 07 08:45:09.095211 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:09.095211 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:45:09.095211 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:09.095211 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:45:09.095211 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:45:09.095211 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:45:09.095211 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:45:09.095211 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:45:09.095211 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:45:09.096677 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:45:09.096677 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 08:45:09.096677 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 08:45:09.096677 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:45:09.096677 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:45:09.096677 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:45:09.096677 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:45:09.096677 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 could not be found. Jun 07 08:45:09.096677 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:09.096677 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:45:09.096677 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:09.096677 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:45:09.096677 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:45:09.096677 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:45:09.096677 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:45:09.096677 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:45:09.096677 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 could not be found. Jun 07 08:45:09.096677 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:09.098353 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-0d7640f8-ff4a-4632-a5cd-dfdd26808065 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] Returning 404 to user: Instance 9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 could not be found. {{(pid=129726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:45:09.098353 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-0d7640f8-ff4a-4632-a5cd-dfdd26808065 tempest-AttachVolumeTestJSON-888820175 tempest-AttachVolumeTestJSON-888820175-project] 10.222.0.17 "GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7" status: 404 len: 111 microversion: 2.1 time: 0.030119 Jun 07 08:45:09.098353 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 386/779] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:09 2022] GET /compute/v2.1/servers/9fd9c43b-ee62-4ae3-98c7-32dbf9c95df7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:45:09.462054 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-28969a7e-1c97-48e3-adae-e09711a593d9 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:09.462667 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-28969a7e-1c97-48e3-adae-e09711a593d9 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] [instance: 25c308d5-2bdd-4ca1-86f2-302d65154eb9] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:09.468716 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-28969a7e-1c97-48e3-adae-e09711a593d9 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:09.469230 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-28969a7e-1c97-48e3-adae-e09711a593d9 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:09.470010 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-28969a7e-1c97-48e3-adae-e09711a593d9 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:09.470445 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-28969a7e-1c97-48e3-adae-e09711a593d9 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:09.723969 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-28969a7e-1c97-48e3-adae-e09711a593d9 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895951de660840628ca5ec61d4f311cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5703dfcb5e4ff8826addb6ca478e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:09.734114 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-28969a7e-1c97-48e3-adae-e09711a593d9 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] 10.222.0.17 "GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9" status: 200 len: 1314 microversion: 2.1 time: 0.275801 Jun 07 08:45:09.734832 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 394/780] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:09 2022] GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:45:10.751895 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-3729d8c0-af1e-4149-8b51-b36545ed2b48 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:10.752523 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-3729d8c0-af1e-4149-8b51-b36545ed2b48 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] [instance: 25c308d5-2bdd-4ca1-86f2-302d65154eb9] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:10.755438 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell0:SELECT=2 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:45:10.760932 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3729d8c0-af1e-4149-8b51-b36545ed2b48 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:10.761432 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3729d8c0-af1e-4149-8b51-b36545ed2b48 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:10.764004 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3729d8c0-af1e-4149-8b51-b36545ed2b48 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:10.764004 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3729d8c0-af1e-4149-8b51-b36545ed2b48 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:10.901389 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-3729d8c0-af1e-4149-8b51-b36545ed2b48 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895951de660840628ca5ec61d4f311cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5703dfcb5e4ff8826addb6ca478e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:10.909372 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-3729d8c0-af1e-4149-8b51-b36545ed2b48 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] 10.222.0.17 "GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9" status: 200 len: 1314 microversion: 2.1 time: 0.161473 Jun 07 08:45:10.910053 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 387/781] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:10 2022] GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:45:11.740309 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell0:SELECT=2 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:45:11.742026 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell0:SELECT=8 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:45:11.749207 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-df2cc711-b28f-414c-8e92-694061cd3a1e req-52b12b8a-a07f-47a3-bd05-652f44a80973 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c308d5-2bdd-4ca1-86f2-302d65154eb9", "name": "network-vif-plugged", "status": "completed", "tag": "dca0d3e5-0728-4b5e-9658-d3963ab570bc"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:45:11.758578 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-df2cc711-b28f-414c-8e92-694061cd3a1e req-52b12b8a-a07f-47a3-bd05-652f44a80973 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:11.759160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-df2cc711-b28f-414c-8e92-694061cd3a1e req-52b12b8a-a07f-47a3-bd05-652f44a80973 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:11.771732 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-df2cc711-b28f-414c-8e92-694061cd3a1e req-52b12b8a-a07f-47a3-bd05-652f44a80973 service nova] Creating event network-vif-plugged:dca0d3e5-0728-4b5e-9658-d3963ab570bc for instance 25c308d5-2bdd-4ca1-86f2-302d65154eb9 on hv-cinder-74014 Jun 07 08:45:11.776919 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-df2cc711-b28f-414c-8e92-694061cd3a1e req-52b12b8a-a07f-47a3-bd05-652f44a80973 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038509 Jun 07 08:45:11.779577 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 395/782] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:45:11.927199 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-0dbe4cdf-3955-47d6-88af-c415d6e0bef2 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:11.927677 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-0dbe4cdf-3955-47d6-88af-c415d6e0bef2 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] [instance: 25c308d5-2bdd-4ca1-86f2-302d65154eb9] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:11.934241 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0dbe4cdf-3955-47d6-88af-c415d6e0bef2 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:11.934907 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0dbe4cdf-3955-47d6-88af-c415d6e0bef2 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:11.935859 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0dbe4cdf-3955-47d6-88af-c415d6e0bef2 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:11.936303 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0dbe4cdf-3955-47d6-88af-c415d6e0bef2 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:12.137612 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-0dbe4cdf-3955-47d6-88af-c415d6e0bef2 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895951de660840628ca5ec61d4f311cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5703dfcb5e4ff8826addb6ca478e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:12.145480 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-0dbe4cdf-3955-47d6-88af-c415d6e0bef2 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] 10.222.0.17 "GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9" status: 200 len: 1314 microversion: 2.1 time: 0.222882 Jun 07 08:45:12.146035 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 388/783] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:11 2022] GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:45:13.163825 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-823764c1-d5f2-44a9-a670-009b1ebd5d0e tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:13.164571 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-823764c1-d5f2-44a9-a670-009b1ebd5d0e tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] [instance: 25c308d5-2bdd-4ca1-86f2-302d65154eb9] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:13.173246 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-823764c1-d5f2-44a9-a670-009b1ebd5d0e tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:13.173632 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-823764c1-d5f2-44a9-a670-009b1ebd5d0e tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:13.179534 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-823764c1-d5f2-44a9-a670-009b1ebd5d0e tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:13.180168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-823764c1-d5f2-44a9-a670-009b1ebd5d0e tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:13.317779 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-823764c1-d5f2-44a9-a670-009b1ebd5d0e tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895951de660840628ca5ec61d4f311cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5703dfcb5e4ff8826addb6ca478e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:13.325993 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-823764c1-d5f2-44a9-a670-009b1ebd5d0e tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] 10.222.0.17 "GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9" status: 200 len: 1314 microversion: 2.1 time: 0.166396 Jun 07 08:45:13.326586 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 396/784] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:13 2022] GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:45:14.342515 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-736f5b1c-434f-4cce-aefe-4484b193c97a tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:14.343126 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-736f5b1c-434f-4cce-aefe-4484b193c97a tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] [instance: 25c308d5-2bdd-4ca1-86f2-302d65154eb9] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:14.349635 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-736f5b1c-434f-4cce-aefe-4484b193c97a tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:14.350084 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-736f5b1c-434f-4cce-aefe-4484b193c97a tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:14.350845 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-736f5b1c-434f-4cce-aefe-4484b193c97a tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:14.351274 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-736f5b1c-434f-4cce-aefe-4484b193c97a tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:14.483246 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-736f5b1c-434f-4cce-aefe-4484b193c97a tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895951de660840628ca5ec61d4f311cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5703dfcb5e4ff8826addb6ca478e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:14.490550 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-736f5b1c-434f-4cce-aefe-4484b193c97a tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] 10.222.0.17 "GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9" status: 200 len: 1464 microversion: 2.1 time: 0.152299 Jun 07 08:45:14.491107 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 389/785] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:14 2022] GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9 => generated 1464 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:45:14.532412 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-e79b3b4e-64ea-43f2-acba-8e60f357cacc tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:14.532900 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-e79b3b4e-64ea-43f2-acba-8e60f357cacc tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] [instance: 25c308d5-2bdd-4ca1-86f2-302d65154eb9] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:14.539766 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e79b3b4e-64ea-43f2-acba-8e60f357cacc tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:14.540212 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e79b3b4e-64ea-43f2-acba-8e60f357cacc tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:14.540971 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e79b3b4e-64ea-43f2-acba-8e60f357cacc tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:14.541627 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e79b3b4e-64ea-43f2-acba-8e60f357cacc tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:14.567957 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-e79b3b4e-64ea-43f2-acba-8e60f357cacc tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] [instance: 25c308d5-2bdd-4ca1-86f2-302d65154eb9] Going to try to terminate instance {{(pid=129725) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 08:45:14.592144 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=100 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:45:14.802466 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-e79b3b4e-64ea-43f2-acba-8e60f357cacc tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] 10.222.0.17 "DELETE /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9" status: 204 len: 0 microversion: 2.1 time: 0.274787 Jun 07 08:45:14.803050 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 397/786] 10.222.0.17 () {58 vars in 1238 bytes} [Tue Jun 7 08:45:14 2022] DELETE /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 08:45:14.811299 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-8362b346-5701-4fff-bdc9-a59a00d2795b tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:14.811946 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-8362b346-5701-4fff-bdc9-a59a00d2795b tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] [instance: 25c308d5-2bdd-4ca1-86f2-302d65154eb9] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:14.818017 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8362b346-5701-4fff-bdc9-a59a00d2795b tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:14.818476 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8362b346-5701-4fff-bdc9-a59a00d2795b tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:14.819239 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8362b346-5701-4fff-bdc9-a59a00d2795b tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:14.819679 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8362b346-5701-4fff-bdc9-a59a00d2795b tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:14.950120 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-8362b346-5701-4fff-bdc9-a59a00d2795b tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895951de660840628ca5ec61d4f311cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5703dfcb5e4ff8826addb6ca478e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:14.957149 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-8362b346-5701-4fff-bdc9-a59a00d2795b tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] 10.222.0.17 "GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9" status: 200 len: 1470 microversion: 2.1 time: 0.149806 Jun 07 08:45:14.957717 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 390/787] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:14 2022] GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9 => generated 1470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:45:15.975562 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-d1f72766-758d-4179-bfdc-2aeda5e04e4e tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:15.976247 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-d1f72766-758d-4179-bfdc-2aeda5e04e4e tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] [instance: 25c308d5-2bdd-4ca1-86f2-302d65154eb9] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:15.982723 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d1f72766-758d-4179-bfdc-2aeda5e04e4e tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:15.983223 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d1f72766-758d-4179-bfdc-2aeda5e04e4e tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:15.984162 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d1f72766-758d-4179-bfdc-2aeda5e04e4e tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:15.984605 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d1f72766-758d-4179-bfdc-2aeda5e04e4e tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:16.118956 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-d1f72766-758d-4179-bfdc-2aeda5e04e4e tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895951de660840628ca5ec61d4f311cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5703dfcb5e4ff8826addb6ca478e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:16.127336 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-d1f72766-758d-4179-bfdc-2aeda5e04e4e tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] 10.222.0.17 "GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9" status: 200 len: 1470 microversion: 2.1 time: 0.155994 Jun 07 08:45:16.127914 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 398/788] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:15 2022] GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9 => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:45:16.871057 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-a14cfb5d-71d1-464e-9531-ab4479807b7f req-d7c67079-4064-4568-84cb-a02deb42edd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c308d5-2bdd-4ca1-86f2-302d65154eb9", "name": "network-vif-deleted", "tag": "dca0d3e5-0728-4b5e-9658-d3963ab570bc"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:45:16.879098 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:45:16.882982 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-a14cfb5d-71d1-464e-9531-ab4479807b7f req-d7c67079-4064-4568-84cb-a02deb42edd0 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:16.883611 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-a14cfb5d-71d1-464e-9531-ab4479807b7f req-d7c67079-4064-4568-84cb-a02deb42edd0 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:16.896187 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-a14cfb5d-71d1-464e-9531-ab4479807b7f req-d7c67079-4064-4568-84cb-a02deb42edd0 service nova] Creating event network-vif-deleted:dca0d3e5-0728-4b5e-9658-d3963ab570bc for instance 25c308d5-2bdd-4ca1-86f2-302d65154eb9 on hv-cinder-74014 Jun 07 08:45:16.902119 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-a14cfb5d-71d1-464e-9531-ab4479807b7f req-d7c67079-4064-4568-84cb-a02deb42edd0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035773 Jun 07 08:45:16.903267 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 391/789] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:45:17.144493 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-89f25d66-1aa0-4aa9-a545-3c0a5c57785f tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:17.145161 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-89f25d66-1aa0-4aa9-a545-3c0a5c57785f tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] [instance: 25c308d5-2bdd-4ca1-86f2-302d65154eb9] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:17.151657 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-89f25d66-1aa0-4aa9-a545-3c0a5c57785f tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:17.153508 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-89f25d66-1aa0-4aa9-a545-3c0a5c57785f tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:17.153622 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-89f25d66-1aa0-4aa9-a545-3c0a5c57785f tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:17.154332 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-89f25d66-1aa0-4aa9-a545-3c0a5c57785f tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:17.226655 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-89f25d66-1aa0-4aa9-a545-3c0a5c57785f tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '895951de660840628ca5ec61d4f311cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5703dfcb5e4ff8826addb6ca478e51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:17.234356 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-89f25d66-1aa0-4aa9-a545-3c0a5c57785f tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] 10.222.0.17 "GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9" status: 200 len: 1299 microversion: 2.1 time: 0.093919 Jun 07 08:45:17.234975 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 399/790] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:17 2022] GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9 => generated 1299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:45:18.252234 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-85cb5b16-9382-4991-bc89-010ef447cdb8 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:18.252924 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-85cb5b16-9382-4991-bc89-010ef447cdb8 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] [instance: 25c308d5-2bdd-4ca1-86f2-302d65154eb9] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:18.264336 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-85cb5b16-9382-4991-bc89-010ef447cdb8 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:18.264881 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-85cb5b16-9382-4991-bc89-010ef447cdb8 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:18.266242 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-85cb5b16-9382-4991-bc89-010ef447cdb8 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:18.266242 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-85cb5b16-9382-4991-bc89-010ef447cdb8 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:18.284756 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.wsgi [None req-85cb5b16-9382-4991-bc89-010ef447cdb8 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] HTTP exception thrown: Instance 25c308d5-2bdd-4ca1-86f2-302d65154eb9 could not be found. Jun 07 08:45:18.286455 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-85cb5b16-9382-4991-bc89-010ef447cdb8 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Request method failure captured: Jun 07 08:45:18.286455 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: request: GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9 HTTP/1.1 Jun 07 08:45:18.286455 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept: application/json Jun 07 08:45:18.286455 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept-Encoding: identity Jun 07 08:45:18.286455 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Connection: close Jun 07 08:45:18.286455 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Length: 0 Jun 07 08:45:18.286455 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Type: application/json Jun 07 08:45:18.286455 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Host: 10.222.0.17 Jun 07 08:45:18.286455 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Openstack-System-Scope: None Jun 07 08:45:18.286455 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: User-Agent: python-urllib3/1.26.9 Jun 07 08:45:18.286455 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Auth-Token: gAAAAABinxAJ8odLcicec7nNvY5HXIgsgLPUCgaDckkk4aq-oWXYwa3HWvgaIYnMmE9dy91KtKjwKLdayMJykYP7QTHrF_oS85a-yG1kHW08pSMTuEvOq_hlF3II7DiI5VWJSjbxi_oN16lVshU-hBuGtwqnd0ZJ28lkVLvV1-eHUX3tUt2kn7U Jun 07 08:45:18.286455 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Id: None Jun 07 08:45:18.286455 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Name: None Jun 07 08:45:18.286455 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Identity-Status: Confirmed Jun 07 08:45:18.286455 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Is-Admin-Project: True Jun 07 08:45:18.286455 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Id: default Jun 07 08:45:18.286455 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Name: Default Jun 07 08:45:18.286455 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Id: ec5703dfcb5e4ff8826addb6ca478e51 Jun 07 08:45:18.286455 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Name: tempest-VolumesNegativeTest-567960432 Jun 07 08:45:18.286455 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Role: reader,member Jun 07 08:45:18.286455 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Roles: reader,member Jun 07 08:45:18.287796 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ec5703dfcb5e4ff8826addb6ca478e51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ec5703dfcb5e4ff8826addb6ca478e51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ec5703dfcb5e4ff8826addb6ca478e51", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ec5703dfcb5e4ff8826addb6ca478e51"}]}] Jun 07 08:45:18.287796 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant: tempest-VolumesNegativeTest-567960432 Jun 07 08:45:18.287796 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Id: ec5703dfcb5e4ff8826addb6ca478e51 Jun 07 08:45:18.287796 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Name: tempest-VolumesNegativeTest-567960432 Jun 07 08:45:18.287796 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User: tempest-VolumesNegativeTest-567960432-project Jun 07 08:45:18.287796 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Id: default Jun 07 08:45:18.287796 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Name: Default Jun 07 08:45:18.287796 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Id: 895951de660840628ca5ec61d4f311cc Jun 07 08:45:18.287796 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Name: tempest-VolumesNegativeTest-567960432-project Jun 07 08:45:18.287796 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: method: > Jun 07 08:45:18.287796 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: exception: Instance 25c308d5-2bdd-4ca1-86f2-302d65154eb9 could not be found. Jun 07 08:45:18.287796 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: action_args: {'id': '25c308d5-2bdd-4ca1-86f2-302d65154eb9'} Jun 07 08:45:18.288576 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:45:18.288576 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:45:18.288576 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:45:18.288576 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:45:18.288576 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:45:18.288576 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:45:18.288576 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:45:18.288576 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:45:18.288576 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:45:18.288576 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:45:18.288576 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25c308d5-2bdd-4ca1-86f2-302d65154eb9 could not be found. Jun 07 08:45:18.288576 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:18.288576 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:45:18.288576 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:18.288576 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:45:18.288576 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:45:18.288576 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:45:18.288576 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:45:18.288576 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:45:18.288576 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:45:18.290901 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:45:18.290901 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 08:45:18.290901 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 08:45:18.290901 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:45:18.290901 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:45:18.290901 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:45:18.290901 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:45:18.290901 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25c308d5-2bdd-4ca1-86f2-302d65154eb9 could not be found. Jun 07 08:45:18.290901 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:18.290901 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:45:18.290901 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:18.290901 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:45:18.290901 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:45:18.290901 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:45:18.290901 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:45:18.290901 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:45:18.290901 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25c308d5-2bdd-4ca1-86f2-302d65154eb9 could not be found. Jun 07 08:45:18.290901 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:18.292021 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-85cb5b16-9382-4991-bc89-010ef447cdb8 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] Returning 404 to user: Instance 25c308d5-2bdd-4ca1-86f2-302d65154eb9 could not be found. {{(pid=129726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:45:18.292021 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-85cb5b16-9382-4991-bc89-010ef447cdb8 tempest-VolumesNegativeTest-567960432 tempest-VolumesNegativeTest-567960432-project] 10.222.0.17 "GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9" status: 404 len: 111 microversion: 2.1 time: 0.041734 Jun 07 08:45:18.292021 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 392/791] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:18 2022] GET /compute/v2.1/servers/25c308d5-2bdd-4ca1-86f2-302d65154eb9 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:45:20.806050 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-01466ac1-6683-4aad-ac28-3dd63605a7ca tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Action: 'create', calling method: .version_select at 0x7f7fed2923a0>, body: {"keypair": {"name": "tempest-keypair-474949863", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNbHi4jewvSiLxje3qn9o0JrAxuaNEYVsSuMC1LKXVohcjBBoS3nhgNcFzAuxEFAEu20BydY5I//equiclNRY7yb0tA5q9WaebaJmSBQg/G42pEY3g4qaoB0Vi4hjE6YA=="}} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:45:20.822441 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.quota [None req-01466ac1-6683-4aad-ac28-3dd63605a7ca tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Getting quotas for project 0899cad1b7c64a0199b3466d4c7cfefb. Resources: {'key_pairs'} {{(pid=129725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 08:45:20.826500 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.quota [None req-01466ac1-6683-4aad-ac28-3dd63605a7ca tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Getting quotas for user 52ddf59fe764404eb1c6ee745e21d352 and project 0899cad1b7c64a0199b3466d4c7cfefb. Resources: {'key_pairs'} {{(pid=129725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 08:45:20.952087 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-01466ac1-6683-4aad-ac28-3dd63605a7ca tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.280400 Jun 07 08:45:20.955265 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 400/792] 10.222.0.17 () {60 vars in 1158 bytes} [Tue Jun 7 08:45:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:45:23.626506 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-06500cf2-346c-45aa-91e4-c2644822ca74 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2108035268", "imageRef": "c04b0a92-7675-47c3-bcc2-8a2a59b997c3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "887f6fc8-6e65-421d-990a-570b64e04d42"}], "security_groups": [{"name": "tempest-securitygroup--260338311"}], "key_name": "tempest-keypair-474949863", "user_data": "}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:45:23.754580 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.network.neutron [None req-06500cf2-346c-45aa-91e4-c2644822ca74 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] validate_networks() for [('887f6fc8-6e65-421d-990a-570b64e04d42', None, None, None, None, None)] {{(pid=129726) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 08:45:24.195921 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-06500cf2-346c-45aa-91e4-c2644822ca74 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Flavor limits 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 08:45:24.196268 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-06500cf2-346c-45aa-91e4-c2644822ca74 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Image limits 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 08:45:24.196808 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-06500cf2-346c-45aa-91e4-c2644822ca74 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Flavor pref 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 08:45:24.197473 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-06500cf2-346c-45aa-91e4-c2644822ca74 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Image pref 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 08:45:24.198225 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-06500cf2-346c-45aa-91e4-c2644822ca74 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 08:45:24.208765 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-06500cf2-346c-45aa-91e4-c2644822ca74 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:24.209599 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-06500cf2-346c-45aa-91e4-c2644822ca74 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:24.210408 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-06500cf2-346c-45aa-91e4-c2644822ca74 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:24.210931 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-06500cf2-346c-45aa-91e4-c2644822ca74 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:24.230692 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-06500cf2-346c-45aa-91e4-c2644822ca74 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Getting quotas for project 0899cad1b7c64a0199b3466d4c7cfefb. Resources: {'ram', 'cores', 'instances'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 08:45:24.235179 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-06500cf2-346c-45aa-91e4-c2644822ca74 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Getting quotas for user 52ddf59fe764404eb1c6ee745e21d352 and project 0899cad1b7c64a0199b3466d4c7cfefb. Resources: {'ram', 'cores', 'instances'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 08:45:24.247733 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-06500cf2-346c-45aa-91e4-c2644822ca74 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Going to run 1 instances... {{(pid=129726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 08:45:24.250109 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-06500cf2-346c-45aa-91e4-c2644822ca74 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c04b0a92-7675-47c3-bcc2-8a2a59b997c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 08:45:24.410721 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-06500cf2-346c-45aa-91e4-c2644822ca74 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.788895 Jun 07 08:45:24.411948 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 393/793] 10.222.0.17 () {60 vars in 1146 bytes} [Tue Jun 7 08:45:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 08:45:24.422411 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-03d84bb0-08fb-4dc5-aefb-3dbbee36b9ae tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:24.423084 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-03d84bb0-08fb-4dc5-aefb-3dbbee36b9ae tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:24.485673 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-03d84bb0-08fb-4dc5-aefb-3dbbee36b9ae tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:24.497241 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-03d84bb0-08fb-4dc5-aefb-3dbbee36b9ae tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22" status: 200 len: 1241 microversion: 2.1 time: 0.078479 Jun 07 08:45:24.498060 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 401/794] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:24 2022] GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:45:25.515220 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-b896eb4c-658e-419a-8885-0ef7dbb33614 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:25.532839 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-b896eb4c-658e-419a-8885-0ef7dbb33614 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:25.532839 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b896eb4c-658e-419a-8885-0ef7dbb33614 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:25.532839 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b896eb4c-658e-419a-8885-0ef7dbb33614 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:25.532839 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b896eb4c-658e-419a-8885-0ef7dbb33614 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:25.533759 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b896eb4c-658e-419a-8885-0ef7dbb33614 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:25.597422 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-b896eb4c-658e-419a-8885-0ef7dbb33614 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:25.605955 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-b896eb4c-658e-419a-8885-0ef7dbb33614 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22" status: 200 len: 1245 microversion: 2.1 time: 0.095246 Jun 07 08:45:25.606546 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 394/795] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:25 2022] GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 => generated 1245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:45:26.621956 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-7dd6258e-aa14-4058-9323-d23f1e314bb8 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:26.622643 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-7dd6258e-aa14-4058-9323-d23f1e314bb8 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:26.630046 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7dd6258e-aa14-4058-9323-d23f1e314bb8 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:26.630613 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7dd6258e-aa14-4058-9323-d23f1e314bb8 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:26.631505 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7dd6258e-aa14-4058-9323-d23f1e314bb8 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:26.632063 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7dd6258e-aa14-4058-9323-d23f1e314bb8 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:26.718233 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-7dd6258e-aa14-4058-9323-d23f1e314bb8 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:26.725956 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-7dd6258e-aa14-4058-9323-d23f1e314bb8 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22" status: 200 len: 1301 microversion: 2.1 time: 0.107800 Jun 07 08:45:26.726529 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 402/796] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:26 2022] GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 => generated 1301 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:45:27.744062 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-c400414e-7ce9-49c2-92a7-73d8ea675f37 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:27.744702 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-c400414e-7ce9-49c2-92a7-73d8ea675f37 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:27.751726 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c400414e-7ce9-49c2-92a7-73d8ea675f37 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:27.752170 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c400414e-7ce9-49c2-92a7-73d8ea675f37 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:27.752958 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c400414e-7ce9-49c2-92a7-73d8ea675f37 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:27.753418 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c400414e-7ce9-49c2-92a7-73d8ea675f37 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:27.892406 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-c400414e-7ce9-49c2-92a7-73d8ea675f37 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:27.895019 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=100 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:45:27.900706 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-c400414e-7ce9-49c2-92a7-73d8ea675f37 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22" status: 200 len: 1366 microversion: 2.1 time: 0.160546 Jun 07 08:45:27.901301 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 395/797] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:27 2022] GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:45:28.510670 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-46997097-7a77-481f-b629-3f48f4cd289e req-27abd953-d3bc-4e8a-9212-37785319036b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22", "tag": "cb4a5e6c-f7ac-4c67-a28c-5b44fe5f7fdb"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:45:28.515087 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:45:28.520596 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-46997097-7a77-481f-b629-3f48f4cd289e req-27abd953-d3bc-4e8a-9212-37785319036b service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:28.521133 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-46997097-7a77-481f-b629-3f48f4cd289e req-27abd953-d3bc-4e8a-9212-37785319036b service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:28.534489 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-46997097-7a77-481f-b629-3f48f4cd289e req-27abd953-d3bc-4e8a-9212-37785319036b service nova] Creating event network-changed:cb4a5e6c-f7ac-4c67-a28c-5b44fe5f7fdb for instance a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 on hv-cinder-74014 Jun 07 08:45:28.539428 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-46997097-7a77-481f-b629-3f48f4cd289e req-27abd953-d3bc-4e8a-9212-37785319036b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032761 Jun 07 08:45:28.540092 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 403/798] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:45:28.918747 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-d5957890-4d6d-40e2-9892-9fc170b2d39a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:28.919371 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-d5957890-4d6d-40e2-9892-9fc170b2d39a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:28.926118 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d5957890-4d6d-40e2-9892-9fc170b2d39a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:28.926576 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d5957890-4d6d-40e2-9892-9fc170b2d39a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:28.927346 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d5957890-4d6d-40e2-9892-9fc170b2d39a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:28.927794 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d5957890-4d6d-40e2-9892-9fc170b2d39a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:29.062028 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-d5957890-4d6d-40e2-9892-9fc170b2d39a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:29.069656 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-d5957890-4d6d-40e2-9892-9fc170b2d39a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22" status: 200 len: 1366 microversion: 2.1 time: 0.155642 Jun 07 08:45:29.070571 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 396/799] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:28 2022] GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:45:30.088811 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-15f08c35-c33d-49ce-999f-b71bbe031cdc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:30.089452 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-15f08c35-c33d-49ce-999f-b71bbe031cdc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:30.096288 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-15f08c35-c33d-49ce-999f-b71bbe031cdc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:30.096734 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-15f08c35-c33d-49ce-999f-b71bbe031cdc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:30.097522 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-15f08c35-c33d-49ce-999f-b71bbe031cdc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:30.097953 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-15f08c35-c33d-49ce-999f-b71bbe031cdc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:30.243798 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-15f08c35-c33d-49ce-999f-b71bbe031cdc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:30.251456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-15f08c35-c33d-49ce-999f-b71bbe031cdc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22" status: 200 len: 1366 microversion: 2.1 time: 0.168474 Jun 07 08:45:30.252019 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 404/800] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:30 2022] GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:45:31.268284 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-4d6daa47-cf67-4586-8f7a-1d20c96039d2 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:31.268934 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-4d6daa47-cf67-4586-8f7a-1d20c96039d2 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:31.275216 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4d6daa47-cf67-4586-8f7a-1d20c96039d2 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:31.275659 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4d6daa47-cf67-4586-8f7a-1d20c96039d2 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:31.276409 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4d6daa47-cf67-4586-8f7a-1d20c96039d2 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:31.276840 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4d6daa47-cf67-4586-8f7a-1d20c96039d2 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:31.411591 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-4d6daa47-cf67-4586-8f7a-1d20c96039d2 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:31.419405 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-4d6daa47-cf67-4586-8f7a-1d20c96039d2 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22" status: 200 len: 1366 microversion: 2.1 time: 0.155019 Jun 07 08:45:31.419956 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 397/801] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:31 2022] GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:45:32.436809 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-d52792b0-510f-4213-b0c3-83a9b8b4c66c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:32.437485 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-d52792b0-510f-4213-b0c3-83a9b8b4c66c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:32.443971 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d52792b0-510f-4213-b0c3-83a9b8b4c66c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:32.444424 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d52792b0-510f-4213-b0c3-83a9b8b4c66c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:32.445223 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d52792b0-510f-4213-b0c3-83a9b8b4c66c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:32.445663 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d52792b0-510f-4213-b0c3-83a9b8b4c66c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:32.572574 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-d52792b0-510f-4213-b0c3-83a9b8b4c66c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:32.579971 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-d52792b0-510f-4213-b0c3-83a9b8b4c66c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22" status: 200 len: 1366 microversion: 2.1 time: 0.147546 Jun 07 08:45:32.580536 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 405/802] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:32 2022] GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:45:33.596742 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-18150399-151d-4b45-b3b6-ff0fce45b6cd tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:33.597383 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-18150399-151d-4b45-b3b6-ff0fce45b6cd tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:33.603990 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-18150399-151d-4b45-b3b6-ff0fce45b6cd tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:33.604438 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-18150399-151d-4b45-b3b6-ff0fce45b6cd tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:33.605348 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-18150399-151d-4b45-b3b6-ff0fce45b6cd tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:33.606283 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-18150399-151d-4b45-b3b6-ff0fce45b6cd tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:33.734107 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-18150399-151d-4b45-b3b6-ff0fce45b6cd tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:33.741996 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-18150399-151d-4b45-b3b6-ff0fce45b6cd tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22" status: 200 len: 1366 microversion: 2.1 time: 0.148952 Jun 07 08:45:33.742553 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 398/803] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:33 2022] GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:45:33.859520 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-233772f4-8f3d-4750-afa5-6e160c8e2f72 req-0e81c60d-a5e7-4452-9716-deeb2d5d26ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22", "name": "network-vif-plugged", "status": "completed", "tag": "cb4a5e6c-f7ac-4c67-a28c-5b44fe5f7fdb"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:45:33.868077 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-233772f4-8f3d-4750-afa5-6e160c8e2f72 req-0e81c60d-a5e7-4452-9716-deeb2d5d26ba service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:33.868528 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-233772f4-8f3d-4750-afa5-6e160c8e2f72 req-0e81c60d-a5e7-4452-9716-deeb2d5d26ba service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:33.880145 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-233772f4-8f3d-4750-afa5-6e160c8e2f72 req-0e81c60d-a5e7-4452-9716-deeb2d5d26ba service nova] Creating event network-vif-plugged:cb4a5e6c-f7ac-4c67-a28c-5b44fe5f7fdb for instance a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 on hv-cinder-74014 Jun 07 08:45:33.885327 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-233772f4-8f3d-4750-afa5-6e160c8e2f72 req-0e81c60d-a5e7-4452-9716-deeb2d5d26ba service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030682 Jun 07 08:45:33.886263 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 406/804] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:45:34.188821 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-8c676b1a-121e-41b0-a699-a0d99a1160ee tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:34.189858 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-8c676b1a-121e-41b0-a699-a0d99a1160ee tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:34.196084 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8c676b1a-121e-41b0-a699-a0d99a1160ee tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:34.196532 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8c676b1a-121e-41b0-a699-a0d99a1160ee tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:34.197338 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8c676b1a-121e-41b0-a699-a0d99a1160ee tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:34.197771 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8c676b1a-121e-41b0-a699-a0d99a1160ee tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:34.220215 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell0:SELECT=2 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:45:34.228985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-8c676b1a-121e-41b0-a699-a0d99a1160ee tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044274 Jun 07 08:45:34.229786 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 399/805] 10.222.0.17 () {60 vars in 1342 bytes} [Tue Jun 7 08:45:34 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:45:34.290668 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-c7b6f92b-07e6-4b2d-b71c-4a57080185d1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:34.291252 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-c7b6f92b-07e6-4b2d-b71c-4a57080185d1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:34.297768 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c7b6f92b-07e6-4b2d-b71c-4a57080185d1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:34.301410 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c7b6f92b-07e6-4b2d-b71c-4a57080185d1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:34.301410 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c7b6f92b-07e6-4b2d-b71c-4a57080185d1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:34.301410 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c7b6f92b-07e6-4b2d-b71c-4a57080185d1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:34.325492 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-c7b6f92b-07e6-4b2d-b71c-4a57080185d1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Going to try to terminate instance {{(pid=129725) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 08:45:34.495852 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell0:SELECT=6 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:45:34.540383 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-c7b6f92b-07e6-4b2d-b71c-4a57080185d1 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 204 len: 0 microversion: 2.20 time: 0.253240 Jun 07 08:45:34.541352 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 407/806] 10.222.0.17 () {60 vars in 1279 bytes} [Tue Jun 7 08:45:34 2022] DELETE /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 07 08:45:34.549727 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-0716e485-c0c1-4bda-8b53-20b2cba913f6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:34.550334 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-0716e485-c0c1-4bda-8b53-20b2cba913f6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:34.552607 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell0:SELECT=6 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:45:34.557652 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0716e485-c0c1-4bda-8b53-20b2cba913f6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:34.558102 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0716e485-c0c1-4bda-8b53-20b2cba913f6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:34.559464 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0716e485-c0c1-4bda-8b53-20b2cba913f6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:34.559802 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0716e485-c0c1-4bda-8b53-20b2cba913f6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:34.693099 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-0716e485-c0c1-4bda-8b53-20b2cba913f6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:34.701646 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-0716e485-c0c1-4bda-8b53-20b2cba913f6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:34.703163 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-0716e485-c0c1-4bda-8b53-20b2cba913f6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:34.704332 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-0716e485-c0c1-4bda-8b53-20b2cba913f6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1723 microversion: 2.20 time: 0.158503 Jun 07 08:45:34.704888 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 400/807] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:45:34 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:45:34.760234 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-2227255a-284e-4b9e-964a-e3cc10aaaae6 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:34.760866 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-2227255a-284e-4b9e-964a-e3cc10aaaae6 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:34.767705 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2227255a-284e-4b9e-964a-e3cc10aaaae6 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:34.768160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2227255a-284e-4b9e-964a-e3cc10aaaae6 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:34.768923 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2227255a-284e-4b9e-964a-e3cc10aaaae6 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:34.769389 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2227255a-284e-4b9e-964a-e3cc10aaaae6 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:34.903055 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-2227255a-284e-4b9e-964a-e3cc10aaaae6 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:34.910882 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-2227255a-284e-4b9e-964a-e3cc10aaaae6 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22" status: 200 len: 1366 microversion: 2.1 time: 0.155195 Jun 07 08:45:34.911443 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 408/808] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:34 2022] GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:45:35.722262 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-acfefb6e-11d6-447a-8d9f-1649650b5a4b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:35.722786 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-acfefb6e-11d6-447a-8d9f-1649650b5a4b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:35.729257 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-acfefb6e-11d6-447a-8d9f-1649650b5a4b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:35.729709 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-acfefb6e-11d6-447a-8d9f-1649650b5a4b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:35.730976 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-acfefb6e-11d6-447a-8d9f-1649650b5a4b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:35.731410 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-acfefb6e-11d6-447a-8d9f-1649650b5a4b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:35.927495 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-7c9f3bea-eaeb-4de2-b2ad-02cbc212d5a1 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:35.928099 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-7c9f3bea-eaeb-4de2-b2ad-02cbc212d5a1 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:35.936365 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7c9f3bea-eaeb-4de2-b2ad-02cbc212d5a1 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:35.936818 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7c9f3bea-eaeb-4de2-b2ad-02cbc212d5a1 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:35.937639 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7c9f3bea-eaeb-4de2-b2ad-02cbc212d5a1 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:35.938078 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7c9f3bea-eaeb-4de2-b2ad-02cbc212d5a1 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:36.025230 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-acfefb6e-11d6-447a-8d9f-1649650b5a4b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:36.033770 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-acfefb6e-11d6-447a-8d9f-1649650b5a4b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:36.035360 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-acfefb6e-11d6-447a-8d9f-1649650b5a4b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:36.036598 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-acfefb6e-11d6-447a-8d9f-1649650b5a4b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1723 microversion: 2.20 time: 0.318320 Jun 07 08:45:36.037283 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 401/809] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:45:35 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1723 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 07 08:45:36.070916 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-7c9f3bea-eaeb-4de2-b2ad-02cbc212d5a1 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:36.078333 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-7c9f3bea-eaeb-4de2-b2ad-02cbc212d5a1 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22" status: 200 len: 1366 microversion: 2.1 time: 0.154618 Jun 07 08:45:36.078888 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 409/810] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:35 2022] GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:45:37.056043 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-13ca1ade-487c-4214-a3ca-e878a11048d2 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:37.056633 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-13ca1ade-487c-4214-a3ca-e878a11048d2 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:37.063734 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-13ca1ade-487c-4214-a3ca-e878a11048d2 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:37.064185 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-13ca1ade-487c-4214-a3ca-e878a11048d2 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:37.064946 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-13ca1ade-487c-4214-a3ca-e878a11048d2 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:37.065414 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-13ca1ade-487c-4214-a3ca-e878a11048d2 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:37.095003 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-41c9a96e-2daa-4678-9aa1-dc97244dd2c0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:37.096835 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-41c9a96e-2daa-4678-9aa1-dc97244dd2c0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:37.103615 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-41c9a96e-2daa-4678-9aa1-dc97244dd2c0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:37.104060 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-41c9a96e-2daa-4678-9aa1-dc97244dd2c0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:37.104830 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-41c9a96e-2daa-4678-9aa1-dc97244dd2c0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:37.105297 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-41c9a96e-2daa-4678-9aa1-dc97244dd2c0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:37.207370 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-13ca1ade-487c-4214-a3ca-e878a11048d2 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:37.215296 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-13ca1ade-487c-4214-a3ca-e878a11048d2 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:37.216883 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-13ca1ade-487c-4214-a3ca-e878a11048d2 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:37.218100 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-13ca1ade-487c-4214-a3ca-e878a11048d2 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1723 microversion: 2.20 time: 0.166218 Jun 07 08:45:37.219348 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 402/811] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:45:37 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:45:37.312642 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-41c9a96e-2daa-4678-9aa1-dc97244dd2c0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:37.321900 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-41c9a96e-2daa-4678-9aa1-dc97244dd2c0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22" status: 200 len: 1556 microversion: 2.1 time: 0.230435 Jun 07 08:45:37.322782 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 410/812] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:45:37 2022] GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 => generated 1556 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:45:37.340784 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-98573904-8f0d-445f-acee-823abe88d324 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:37.341313 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-98573904-8f0d-445f-acee-823abe88d324 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:37.347196 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-98573904-8f0d-445f-acee-823abe88d324 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:37.347650 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-98573904-8f0d-445f-acee-823abe88d324 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:37.348411 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-98573904-8f0d-445f-acee-823abe88d324 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:37.348938 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-98573904-8f0d-445f-acee-823abe88d324 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:37.428938 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-98573904-8f0d-445f-acee-823abe88d324 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091995 Jun 07 08:45:37.429551 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 403/813] 10.222.0.17 () {58 vars in 1274 bytes} [Tue Jun 7 08:45:37 2022] GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:45:37.544132 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-1334550c-3b3d-4733-9ab7-3dc841d3b189 req-a617c196-e002-4f72-92a2-cd6da1e20580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bff05aff-3c16-4b84-b927-eaa3917a4200", "name": "network-vif-deleted", "tag": "ac5f8c52-180a-42f4-8102-9668d2229d61"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:45:37.552561 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-1334550c-3b3d-4733-9ab7-3dc841d3b189 req-a617c196-e002-4f72-92a2-cd6da1e20580 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:37.559380 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-1334550c-3b3d-4733-9ab7-3dc841d3b189 req-a617c196-e002-4f72-92a2-cd6da1e20580 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:37.568423 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-1334550c-3b3d-4733-9ab7-3dc841d3b189 req-a617c196-e002-4f72-92a2-cd6da1e20580 service nova] Creating event network-vif-deleted:ac5f8c52-180a-42f4-8102-9668d2229d61 for instance bff05aff-3c16-4b84-b927-eaa3917a4200 on hv-cinder-74014 Jun 07 08:45:37.574488 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-1334550c-3b3d-4733-9ab7-3dc841d3b189 req-a617c196-e002-4f72-92a2-cd6da1e20580 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034536 Jun 07 08:45:37.575091 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 411/814] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:45:38.237472 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-ef8ab440-d62d-45ea-9f71-2bab2e3c028b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:38.238240 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-ef8ab440-d62d-45ea-9f71-2bab2e3c028b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:38.244806 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ef8ab440-d62d-45ea-9f71-2bab2e3c028b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:38.245289 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ef8ab440-d62d-45ea-9f71-2bab2e3c028b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:38.246065 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ef8ab440-d62d-45ea-9f71-2bab2e3c028b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:38.246504 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ef8ab440-d62d-45ea-9f71-2bab2e3c028b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:38.285148 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ef8ab440-d62d-45ea-9f71-2bab2e3c028b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:38.285599 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ef8ab440-d62d-45ea-9f71-2bab2e3c028b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:38.286345 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.objects.instance [None req-ef8ab440-d62d-45ea-9f71-2bab2e3c028b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lazy-loading 'fault' on Instance uuid bff05aff-3c16-4b84-b927-eaa3917a4200 {{(pid=129726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:45:38.560687 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-ef8ab440-d62d-45ea-9f71-2bab2e3c028b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:38.572974 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-ef8ab440-d62d-45ea-9f71-2bab2e3c028b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:38.575208 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-ef8ab440-d62d-45ea-9f71-2bab2e3c028b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b2efb9857cf495f8b51a96b5f868d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f25f022755d465fac40f2681eaef0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:45:38.576481 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-ef8ab440-d62d-45ea-9f71-2bab2e3c028b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 200 len: 1372 microversion: 2.20 time: 0.343726 Jun 07 08:45:38.577131 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 404/815] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:45:38 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 1372 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 07 08:45:38.774812 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-a9ef4cb2-44fb-4baf-91e5-466934e9f37a req-fa593047-2de3-4cb7-b439-c3dac73cc412 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22", "tag": "cb4a5e6c-f7ac-4c67-a28c-5b44fe5f7fdb"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:45:38.783316 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-a9ef4cb2-44fb-4baf-91e5-466934e9f37a req-fa593047-2de3-4cb7-b439-c3dac73cc412 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:38.783998 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-a9ef4cb2-44fb-4baf-91e5-466934e9f37a req-fa593047-2de3-4cb7-b439-c3dac73cc412 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:38.795673 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-a9ef4cb2-44fb-4baf-91e5-466934e9f37a req-fa593047-2de3-4cb7-b439-c3dac73cc412 service nova] Creating event network-changed:cb4a5e6c-f7ac-4c67-a28c-5b44fe5f7fdb for instance a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 on hv-cinder-74014 Jun 07 08:45:38.802081 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-a9ef4cb2-44fb-4baf-91e5-466934e9f37a req-fa593047-2de3-4cb7-b439-c3dac73cc412 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031655 Jun 07 08:45:38.802917 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 412/816] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:45:39.595231 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-6b7e8fc9-5120-4e34-8661-d22711e0424b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:39.596455 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-6b7e8fc9-5120-4e34-8661-d22711e0424b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:39.602776 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6b7e8fc9-5120-4e34-8661-d22711e0424b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:39.603230 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6b7e8fc9-5120-4e34-8661-d22711e0424b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:39.604005 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6b7e8fc9-5120-4e34-8661-d22711e0424b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:39.604441 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6b7e8fc9-5120-4e34-8661-d22711e0424b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:39.618419 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.wsgi [None req-6b7e8fc9-5120-4e34-8661-d22711e0424b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] HTTP exception thrown: Instance bff05aff-3c16-4b84-b927-eaa3917a4200 could not be found. Jun 07 08:45:39.619985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-6b7e8fc9-5120-4e34-8661-d22711e0424b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Request method failure captured: Jun 07 08:45:39.619985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: request: GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 HTTP/1.1 Jun 07 08:45:39.619985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept: application/json Jun 07 08:45:39.619985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept-Encoding: identity Jun 07 08:45:39.619985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Connection: close Jun 07 08:45:39.619985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Length: 0 Jun 07 08:45:39.619985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Type: application/json Jun 07 08:45:39.619985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Host: 10.222.0.17 Jun 07 08:45:39.619985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Openstack-System-Scope: None Jun 07 08:45:39.619985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: User-Agent: python-urllib3/1.26.9 Jun 07 08:45:39.619985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Auth-Token: gAAAAABinw6AMDrD6cpFa2nDBfKc0fThvicVKBoLZUEL8r-4EbliQlPvbonCatBIRBx6E4P03AiGn4hedL8iaoBeIGYveD1pWEpC0yEaVu0Q4UuUP3RKZeAc6TrfwxZeJ9ULbzTvdDfB3z6t0xdHyYS1_6RGk71dFO4RtIM0K8aToU9kRTECu6g Jun 07 08:45:39.619985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Id: None Jun 07 08:45:39.619985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Name: None Jun 07 08:45:39.619985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Identity-Status: Confirmed Jun 07 08:45:39.619985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Is-Admin-Project: True Jun 07 08:45:39.619985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 08:45:39.619985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Id: default Jun 07 08:45:39.619985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Name: Default Jun 07 08:45:39.619985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Id: 4f25f022755d465fac40f2681eaef0a5 Jun 07 08:45:39.619985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1415936952 Jun 07 08:45:39.619985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Role: reader,member Jun 07 08:45:39.619985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Roles: reader,member Jun 07 08:45:39.621735 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4f25f022755d465fac40f2681eaef0a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4f25f022755d465fac40f2681eaef0a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4f25f022755d465fac40f2681eaef0a5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4f25f022755d465fac40f2681eaef0a5"}]}] Jun 07 08:45:39.621735 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1415936952 Jun 07 08:45:39.621735 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Id: 4f25f022755d465fac40f2681eaef0a5 Jun 07 08:45:39.621735 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1415936952 Jun 07 08:45:39.621735 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User: tempest-AttachVolumeShelveTestJSON-1415936952-project Jun 07 08:45:39.621735 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Id: default Jun 07 08:45:39.621735 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Name: Default Jun 07 08:45:39.621735 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Id: 0b2efb9857cf495f8b51a96b5f868d44 Jun 07 08:45:39.621735 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1415936952-project Jun 07 08:45:39.621735 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: method: > Jun 07 08:45:39.621735 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: exception: Instance bff05aff-3c16-4b84-b927-eaa3917a4200 could not be found. Jun 07 08:45:39.621735 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: action_args: {'id': 'bff05aff-3c16-4b84-b927-eaa3917a4200'} Jun 07 08:45:39.622596 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:45:39.622596 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:45:39.622596 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:45:39.622596 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:45:39.622596 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:45:39.622596 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:45:39.622596 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:45:39.622596 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:45:39.622596 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:45:39.622596 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:45:39.622596 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bff05aff-3c16-4b84-b927-eaa3917a4200 could not be found. Jun 07 08:45:39.622596 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:39.622596 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:45:39.622596 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:39.622596 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:45:39.622596 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:45:39.622596 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:45:39.622596 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:45:39.622596 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:45:39.622596 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:45:39.623873 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:45:39.623873 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 08:45:39.623873 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 08:45:39.623873 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:45:39.623873 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:45:39.623873 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:45:39.623873 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:45:39.623873 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bff05aff-3c16-4b84-b927-eaa3917a4200 could not be found. Jun 07 08:45:39.623873 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:39.623873 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:45:39.623873 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:39.623873 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:45:39.623873 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:45:39.623873 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:45:39.623873 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:45:39.623873 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:45:39.623873 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bff05aff-3c16-4b84-b927-eaa3917a4200 could not be found. Jun 07 08:45:39.623873 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:39.625061 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-6b7e8fc9-5120-4e34-8661-d22711e0424b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Returning 404 to user: Instance bff05aff-3c16-4b84-b927-eaa3917a4200 could not be found. {{(pid=129726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:45:39.625061 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-6b7e8fc9-5120-4e34-8661-d22711e0424b tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 404 len: 111 microversion: 2.20 time: 0.030033 Jun 07 08:45:39.625061 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 405/817] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:45:39 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 08:45:39.631847 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-ad59afe9-8c9c-4c2e-b198-3925daf3f3ce tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '.version_select at 0x7f7fedc48dc0>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:39.694686 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-ad59afe9-8c9c-4c2e-b198-3925daf3f3ce tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1267913270" status: 204 len: 0 microversion: 2.20 time: 0.067162 Jun 07 08:45:39.695284 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 413/818] 10.222.0.17 () {60 vars in 1261 bytes} [Tue Jun 7 08:45:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1267913270 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 07 08:45:41.747820 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-794782b5-2e7c-4391-a10d-038c1917c71f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:41.748315 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-794782b5-2e7c-4391-a10d-038c1917c71f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:41.754929 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-794782b5-2e7c-4391-a10d-038c1917c71f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:41.755375 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-794782b5-2e7c-4391-a10d-038c1917c71f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:41.756129 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-794782b5-2e7c-4391-a10d-038c1917c71f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:41.756559 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-794782b5-2e7c-4391-a10d-038c1917c71f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:41.769726 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.wsgi [None req-794782b5-2e7c-4391-a10d-038c1917c71f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] HTTP exception thrown: Instance bff05aff-3c16-4b84-b927-eaa3917a4200 could not be found. Jun 07 08:45:41.771266 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-794782b5-2e7c-4391-a10d-038c1917c71f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Request method failure captured: Jun 07 08:45:41.771266 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: request: DELETE /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 HTTP/1.1 Jun 07 08:45:41.771266 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept: application/json Jun 07 08:45:41.771266 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept-Encoding: identity Jun 07 08:45:41.771266 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Connection: close Jun 07 08:45:41.771266 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Length: 0 Jun 07 08:45:41.771266 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Type: application/json Jun 07 08:45:41.771266 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Host: 10.222.0.17 Jun 07 08:45:41.771266 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Openstack-System-Scope: None Jun 07 08:45:41.771266 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: User-Agent: python-urllib3/1.26.9 Jun 07 08:45:41.771266 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Auth-Token: gAAAAABinw6AMDrD6cpFa2nDBfKc0fThvicVKBoLZUEL8r-4EbliQlPvbonCatBIRBx6E4P03AiGn4hedL8iaoBeIGYveD1pWEpC0yEaVu0Q4UuUP3RKZeAc6TrfwxZeJ9ULbzTvdDfB3z6t0xdHyYS1_6RGk71dFO4RtIM0K8aToU9kRTECu6g Jun 07 08:45:41.771266 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Id: None Jun 07 08:45:41.771266 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Name: None Jun 07 08:45:41.771266 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Identity-Status: Confirmed Jun 07 08:45:41.771266 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Is-Admin-Project: True Jun 07 08:45:41.771266 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 08:45:41.771266 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Id: default Jun 07 08:45:41.771266 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Name: Default Jun 07 08:45:41.771266 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Id: 4f25f022755d465fac40f2681eaef0a5 Jun 07 08:45:41.771266 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1415936952 Jun 07 08:45:41.771266 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Role: reader,member Jun 07 08:45:41.771266 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Roles: reader,member Jun 07 08:45:41.772942 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4f25f022755d465fac40f2681eaef0a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4f25f022755d465fac40f2681eaef0a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4f25f022755d465fac40f2681eaef0a5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4f25f022755d465fac40f2681eaef0a5"}]}] Jun 07 08:45:41.772942 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1415936952 Jun 07 08:45:41.772942 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Id: 4f25f022755d465fac40f2681eaef0a5 Jun 07 08:45:41.772942 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1415936952 Jun 07 08:45:41.772942 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User: tempest-AttachVolumeShelveTestJSON-1415936952-project Jun 07 08:45:41.772942 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Id: default Jun 07 08:45:41.772942 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Name: Default Jun 07 08:45:41.772942 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Id: 0b2efb9857cf495f8b51a96b5f868d44 Jun 07 08:45:41.772942 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1415936952-project Jun 07 08:45:41.772942 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: method: > Jun 07 08:45:41.772942 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: exception: Instance bff05aff-3c16-4b84-b927-eaa3917a4200 could not be found. Jun 07 08:45:41.772942 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: action_args: {'id': 'bff05aff-3c16-4b84-b927-eaa3917a4200'} Jun 07 08:45:41.773948 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:45:41.773948 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:45:41.773948 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:45:41.773948 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:45:41.773948 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:45:41.773948 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:45:41.773948 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:45:41.773948 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:45:41.773948 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:45:41.773948 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:45:41.773948 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bff05aff-3c16-4b84-b927-eaa3917a4200 could not be found. Jun 07 08:45:41.773948 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:41.773948 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:45:41.773948 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:41.773948 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:45:41.773948 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:45:41.773948 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:45:41.773948 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:45:41.773948 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:45:41.773948 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:45:41.775446 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:45:41.775446 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 08:45:41.775446 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 08:45:41.775446 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 08:45:41.775446 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 08:45:41.775446 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:45:41.775446 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:45:41.775446 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:45:41.775446 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:45:41.775446 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bff05aff-3c16-4b84-b927-eaa3917a4200 could not be found. Jun 07 08:45:41.775446 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:41.775446 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:45:41.775446 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:41.775446 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:45:41.775446 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:45:41.775446 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:45:41.775446 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:45:41.775446 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:45:41.775446 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bff05aff-3c16-4b84-b927-eaa3917a4200 could not be found. Jun 07 08:45:41.775446 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:41.777025 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-794782b5-2e7c-4391-a10d-038c1917c71f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Returning 404 to user: Instance bff05aff-3c16-4b84-b927-eaa3917a4200 could not be found. {{(pid=129726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:45:41.777025 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-794782b5-2e7c-4391-a10d-038c1917c71f tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 404 len: 111 microversion: 2.20 time: 0.029367 Jun 07 08:45:41.777025 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 406/819] 10.222.0.17 () {60 vars in 1279 bytes} [Tue Jun 7 08:45:41 2022] DELETE /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 08:45:41.781646 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-576feb61-dac8-4d60-8fcb-8adb577a759a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:41.782381 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-576feb61-dac8-4d60-8fcb-8adb577a759a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: bff05aff-3c16-4b84-b927-eaa3917a4200] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:41.789123 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-576feb61-dac8-4d60-8fcb-8adb577a759a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:41.789579 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-576feb61-dac8-4d60-8fcb-8adb577a759a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:41.790340 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-576feb61-dac8-4d60-8fcb-8adb577a759a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:41.790783 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-576feb61-dac8-4d60-8fcb-8adb577a759a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:41.804569 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.wsgi [None req-576feb61-dac8-4d60-8fcb-8adb577a759a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] HTTP exception thrown: Instance bff05aff-3c16-4b84-b927-eaa3917a4200 could not be found. Jun 07 08:45:41.806236 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-576feb61-dac8-4d60-8fcb-8adb577a759a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Request method failure captured: Jun 07 08:45:41.806236 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: request: GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 HTTP/1.1 Jun 07 08:45:41.806236 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept: application/json Jun 07 08:45:41.806236 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept-Encoding: identity Jun 07 08:45:41.806236 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Connection: close Jun 07 08:45:41.806236 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Length: 0 Jun 07 08:45:41.806236 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Type: application/json Jun 07 08:45:41.806236 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Host: 10.222.0.17 Jun 07 08:45:41.806236 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Openstack-System-Scope: None Jun 07 08:45:41.806236 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: User-Agent: python-urllib3/1.26.9 Jun 07 08:45:41.806236 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Auth-Token: gAAAAABinw6AMDrD6cpFa2nDBfKc0fThvicVKBoLZUEL8r-4EbliQlPvbonCatBIRBx6E4P03AiGn4hedL8iaoBeIGYveD1pWEpC0yEaVu0Q4UuUP3RKZeAc6TrfwxZeJ9ULbzTvdDfB3z6t0xdHyYS1_6RGk71dFO4RtIM0K8aToU9kRTECu6g Jun 07 08:45:41.806236 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Id: None Jun 07 08:45:41.806236 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Name: None Jun 07 08:45:41.806236 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Identity-Status: Confirmed Jun 07 08:45:41.806236 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Is-Admin-Project: True Jun 07 08:45:41.806236 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 08:45:41.806236 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Id: default Jun 07 08:45:41.806236 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Name: Default Jun 07 08:45:41.806236 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Id: 4f25f022755d465fac40f2681eaef0a5 Jun 07 08:45:41.806236 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1415936952 Jun 07 08:45:41.806236 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Role: reader,member Jun 07 08:45:41.806236 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Roles: reader,member Jun 07 08:45:41.807881 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4f25f022755d465fac40f2681eaef0a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4f25f022755d465fac40f2681eaef0a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4f25f022755d465fac40f2681eaef0a5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4f25f022755d465fac40f2681eaef0a5"}]}] Jun 07 08:45:41.807881 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1415936952 Jun 07 08:45:41.807881 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Id: 4f25f022755d465fac40f2681eaef0a5 Jun 07 08:45:41.807881 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1415936952 Jun 07 08:45:41.807881 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User: tempest-AttachVolumeShelveTestJSON-1415936952-project Jun 07 08:45:41.807881 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Id: default Jun 07 08:45:41.807881 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Name: Default Jun 07 08:45:41.807881 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Id: 0b2efb9857cf495f8b51a96b5f868d44 Jun 07 08:45:41.807881 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1415936952-project Jun 07 08:45:41.807881 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: method: > Jun 07 08:45:41.807881 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: exception: Instance bff05aff-3c16-4b84-b927-eaa3917a4200 could not be found. Jun 07 08:45:41.807881 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: action_args: {'id': 'bff05aff-3c16-4b84-b927-eaa3917a4200'} Jun 07 08:45:41.809445 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:45:41.809445 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:45:41.809445 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:45:41.809445 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:45:41.809445 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:45:41.809445 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:45:41.809445 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:45:41.809445 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:45:41.809445 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:45:41.809445 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:45:41.809445 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bff05aff-3c16-4b84-b927-eaa3917a4200 could not be found. Jun 07 08:45:41.809445 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:45:41.809445 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:45:41.809445 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:45:41.809445 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:45:41.809445 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:45:41.809445 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:45:41.809445 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:45:41.809445 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:45:41.809445 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:45:41.810870 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:45:41.810870 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 08:45:41.810870 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 08:45:41.810870 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:45:41.810870 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:45:41.810870 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:45:41.810870 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:45:41.810870 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bff05aff-3c16-4b84-b927-eaa3917a4200 could not be found. Jun 07 08:45:41.810870 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:45:41.810870 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:45:41.810870 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:45:41.810870 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:45:41.810870 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:45:41.810870 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:45:41.810870 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:45:41.810870 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:45:41.810870 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bff05aff-3c16-4b84-b927-eaa3917a4200 could not be found. Jun 07 08:45:41.810870 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:45:41.812348 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-576feb61-dac8-4d60-8fcb-8adb577a759a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Returning 404 to user: Instance bff05aff-3c16-4b84-b927-eaa3917a4200 could not be found. {{(pid=129725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:45:41.812348 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-576feb61-dac8-4d60-8fcb-8adb577a759a tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200" status: 404 len: 111 microversion: 2.20 time: 0.030280 Jun 07 08:45:41.812348 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 414/820] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:45:41 2022] GET /compute/v2.1/servers/bff05aff-3c16-4b84-b927-eaa3917a4200 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 07 08:45:43.107327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-c74af90d-77fb-46e3-8281-18969cccb81d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:43.107854 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-c74af90d-77fb-46e3-8281-18969cccb81d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:43.115142 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c74af90d-77fb-46e3-8281-18969cccb81d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:43.115587 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c74af90d-77fb-46e3-8281-18969cccb81d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:43.116334 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c74af90d-77fb-46e3-8281-18969cccb81d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:43.116765 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c74af90d-77fb-46e3-8281-18969cccb81d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:43.130737 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.wsgi [None req-c74af90d-77fb-46e3-8281-18969cccb81d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] HTTP exception thrown: Instance 60630f0f-2831-479d-91fc-477b773635ad could not be found. Jun 07 08:45:43.132334 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-c74af90d-77fb-46e3-8281-18969cccb81d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Request method failure captured: Jun 07 08:45:43.132334 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: request: DELETE /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad HTTP/1.1 Jun 07 08:45:43.132334 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept: application/json Jun 07 08:45:43.132334 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept-Encoding: identity Jun 07 08:45:43.132334 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Connection: close Jun 07 08:45:43.132334 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Length: 0 Jun 07 08:45:43.132334 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Type: application/json Jun 07 08:45:43.132334 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Host: 10.222.0.17 Jun 07 08:45:43.132334 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Openstack-System-Scope: None Jun 07 08:45:43.132334 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: User-Agent: python-urllib3/1.26.9 Jun 07 08:45:43.132334 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Auth-Token: gAAAAABinw6AMDrD6cpFa2nDBfKc0fThvicVKBoLZUEL8r-4EbliQlPvbonCatBIRBx6E4P03AiGn4hedL8iaoBeIGYveD1pWEpC0yEaVu0Q4UuUP3RKZeAc6TrfwxZeJ9ULbzTvdDfB3z6t0xdHyYS1_6RGk71dFO4RtIM0K8aToU9kRTECu6g Jun 07 08:45:43.132334 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Id: None Jun 07 08:45:43.132334 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Name: None Jun 07 08:45:43.132334 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Identity-Status: Confirmed Jun 07 08:45:43.132334 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Is-Admin-Project: True Jun 07 08:45:43.132334 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 08:45:43.132334 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Id: default Jun 07 08:45:43.132334 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Name: Default Jun 07 08:45:43.132334 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Id: 4f25f022755d465fac40f2681eaef0a5 Jun 07 08:45:43.132334 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1415936952 Jun 07 08:45:43.132334 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Role: reader,member Jun 07 08:45:43.132334 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Roles: reader,member Jun 07 08:45:43.134011 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4f25f022755d465fac40f2681eaef0a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4f25f022755d465fac40f2681eaef0a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4f25f022755d465fac40f2681eaef0a5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4f25f022755d465fac40f2681eaef0a5"}]}] Jun 07 08:45:43.134011 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1415936952 Jun 07 08:45:43.134011 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Id: 4f25f022755d465fac40f2681eaef0a5 Jun 07 08:45:43.134011 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1415936952 Jun 07 08:45:43.134011 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User: tempest-AttachVolumeShelveTestJSON-1415936952-project Jun 07 08:45:43.134011 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Id: default Jun 07 08:45:43.134011 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Name: Default Jun 07 08:45:43.134011 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Id: 0b2efb9857cf495f8b51a96b5f868d44 Jun 07 08:45:43.134011 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1415936952-project Jun 07 08:45:43.134011 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: method: > Jun 07 08:45:43.134011 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: exception: Instance 60630f0f-2831-479d-91fc-477b773635ad could not be found. Jun 07 08:45:43.134011 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: action_args: {'id': '60630f0f-2831-479d-91fc-477b773635ad'} Jun 07 08:45:43.135008 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:45:43.135008 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:45:43.135008 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:45:43.135008 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:45:43.135008 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:45:43.135008 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:45:43.135008 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:45:43.135008 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:45:43.135008 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:45:43.135008 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:45:43.135008 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60630f0f-2831-479d-91fc-477b773635ad could not be found. Jun 07 08:45:43.135008 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:43.135008 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:45:43.135008 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:43.135008 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:45:43.135008 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:45:43.135008 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:45:43.135008 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:45:43.135008 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:45:43.135008 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:45:43.136323 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:45:43.136323 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 08:45:43.136323 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 08:45:43.136323 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 08:45:43.136323 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 08:45:43.136323 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:45:43.136323 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:45:43.136323 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:45:43.136323 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:45:43.136323 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60630f0f-2831-479d-91fc-477b773635ad could not be found. Jun 07 08:45:43.136323 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:43.136323 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:45:43.136323 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:43.136323 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:45:43.136323 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:45:43.136323 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:45:43.136323 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:45:43.136323 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:45:43.136323 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60630f0f-2831-479d-91fc-477b773635ad could not be found. Jun 07 08:45:43.136323 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:45:43.137556 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-c74af90d-77fb-46e3-8281-18969cccb81d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Returning 404 to user: Instance 60630f0f-2831-479d-91fc-477b773635ad could not be found. {{(pid=129726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:45:43.137556 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-c74af90d-77fb-46e3-8281-18969cccb81d tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "DELETE /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 404 len: 111 microversion: 2.20 time: 0.030461 Jun 07 08:45:43.137556 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 407/821] 10.222.0.17 () {60 vars in 1279 bytes} [Tue Jun 7 08:45:43 2022] DELETE /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 08:45:43.142537 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-e30cd86d-89ea-4451-8339-f3d6a26733b6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:45:43.143149 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-e30cd86d-89ea-4451-8339-f3d6a26733b6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] [instance: 60630f0f-2831-479d-91fc-477b773635ad] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:45:43.149679 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e30cd86d-89ea-4451-8339-f3d6a26733b6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:43.150125 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e30cd86d-89ea-4451-8339-f3d6a26733b6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:43.150885 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e30cd86d-89ea-4451-8339-f3d6a26733b6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:45:43.151318 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e30cd86d-89ea-4451-8339-f3d6a26733b6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:45:43.165679 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.wsgi [None req-e30cd86d-89ea-4451-8339-f3d6a26733b6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] HTTP exception thrown: Instance 60630f0f-2831-479d-91fc-477b773635ad could not be found. Jun 07 08:45:43.167216 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-e30cd86d-89ea-4451-8339-f3d6a26733b6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Request method failure captured: Jun 07 08:45:43.167216 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: request: GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad HTTP/1.1 Jun 07 08:45:43.167216 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept: application/json Jun 07 08:45:43.167216 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept-Encoding: identity Jun 07 08:45:43.167216 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Connection: close Jun 07 08:45:43.167216 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Length: 0 Jun 07 08:45:43.167216 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Type: application/json Jun 07 08:45:43.167216 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Host: 10.222.0.17 Jun 07 08:45:43.167216 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Openstack-System-Scope: None Jun 07 08:45:43.167216 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: User-Agent: python-urllib3/1.26.9 Jun 07 08:45:43.167216 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Auth-Token: gAAAAABinw6AMDrD6cpFa2nDBfKc0fThvicVKBoLZUEL8r-4EbliQlPvbonCatBIRBx6E4P03AiGn4hedL8iaoBeIGYveD1pWEpC0yEaVu0Q4UuUP3RKZeAc6TrfwxZeJ9ULbzTvdDfB3z6t0xdHyYS1_6RGk71dFO4RtIM0K8aToU9kRTECu6g Jun 07 08:45:43.167216 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Id: None Jun 07 08:45:43.167216 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Name: None Jun 07 08:45:43.167216 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Identity-Status: Confirmed Jun 07 08:45:43.167216 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Is-Admin-Project: True Jun 07 08:45:43.167216 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Openstack-Nova-Api-Version: 2.20 Jun 07 08:45:43.167216 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Id: default Jun 07 08:45:43.167216 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Name: Default Jun 07 08:45:43.167216 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Id: 4f25f022755d465fac40f2681eaef0a5 Jun 07 08:45:43.167216 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1415936952 Jun 07 08:45:43.167216 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Role: reader,member Jun 07 08:45:43.167216 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Roles: reader,member Jun 07 08:45:43.168710 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4f25f022755d465fac40f2681eaef0a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4f25f022755d465fac40f2681eaef0a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4f25f022755d465fac40f2681eaef0a5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4f25f022755d465fac40f2681eaef0a5"}]}] Jun 07 08:45:43.168710 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1415936952 Jun 07 08:45:43.168710 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Id: 4f25f022755d465fac40f2681eaef0a5 Jun 07 08:45:43.168710 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1415936952 Jun 07 08:45:43.168710 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User: tempest-AttachVolumeShelveTestJSON-1415936952-project Jun 07 08:45:43.168710 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Id: default Jun 07 08:45:43.168710 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Name: Default Jun 07 08:45:43.168710 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Id: 0b2efb9857cf495f8b51a96b5f868d44 Jun 07 08:45:43.168710 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1415936952-project Jun 07 08:45:43.168710 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: method: > Jun 07 08:45:43.168710 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: exception: Instance 60630f0f-2831-479d-91fc-477b773635ad could not be found. Jun 07 08:45:43.168710 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: action_args: {'id': '60630f0f-2831-479d-91fc-477b773635ad'} Jun 07 08:45:43.169498 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:45:43.169498 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:45:43.169498 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:45:43.169498 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:45:43.169498 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:45:43.169498 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:45:43.169498 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:45:43.169498 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:45:43.169498 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:45:43.169498 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:45:43.169498 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60630f0f-2831-479d-91fc-477b773635ad could not be found. Jun 07 08:45:43.169498 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:45:43.169498 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:45:43.169498 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:45:43.169498 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:45:43.169498 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:45:43.169498 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:45:43.169498 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:45:43.169498 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:45:43.169498 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:45:43.171028 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:45:43.171028 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 08:45:43.171028 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 08:45:43.171028 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:45:43.171028 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:45:43.171028 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:45:43.171028 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:45:43.171028 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60630f0f-2831-479d-91fc-477b773635ad could not be found. Jun 07 08:45:43.171028 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:45:43.171028 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:45:43.171028 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:45:43.171028 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:45:43.171028 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:45:43.171028 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:45:43.171028 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:45:43.171028 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:45:43.171028 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60630f0f-2831-479d-91fc-477b773635ad could not be found. Jun 07 08:45:43.171028 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:45:43.172498 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-e30cd86d-89ea-4451-8339-f3d6a26733b6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] Returning 404 to user: Instance 60630f0f-2831-479d-91fc-477b773635ad could not be found. {{(pid=129725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:45:43.172498 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-e30cd86d-89ea-4451-8339-f3d6a26733b6 tempest-AttachVolumeShelveTestJSON-1415936952 tempest-AttachVolumeShelveTestJSON-1415936952-project] 10.222.0.17 "GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad" status: 404 len: 111 microversion: 2.20 time: 0.030424 Jun 07 08:45:43.172498 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 415/822] 10.222.0.17 () {60 vars in 1276 bytes} [Tue Jun 7 08:45:43 2022] GET /compute/v2.1/servers/60630f0f-2831-479d-91fc-477b773635ad => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 07 08:46:14.800843 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-ba85e661-aeca-4ad4-be07-b1e85f9e3fb9 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:46:14.801439 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-ba85e661-aeca-4ad4-be07-b1e85f9e3fb9 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:46:14.803588 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:46:14.804231 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=61 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:46:14.809075 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ba85e661-aeca-4ad4-be07-b1e85f9e3fb9 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:46:14.809532 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ba85e661-aeca-4ad4-be07-b1e85f9e3fb9 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:46:14.810310 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ba85e661-aeca-4ad4-be07-b1e85f9e3fb9 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:46:14.810733 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ba85e661-aeca-4ad4-be07-b1e85f9e3fb9 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:46:14.833465 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-ba85e661-aeca-4ad4-be07-b1e85f9e3fb9 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22/ips" status: 200 len: 150 microversion: 2.1 time: 0.036996 Jun 07 08:46:14.834029 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 408/823] 10.222.0.17 () {58 vars in 1247 bytes} [Tue Jun 7 08:46:14 2022] GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:46:16.590948 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-6c7561b5-f181-406c-9780-6b452b7fd06a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "135f77aa-86da-40c6-83e4-7c85c0bd6e9c"}} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:46:16.592222 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-6c7561b5-f181-406c-9780-6b452b7fd06a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:46:16.594631 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:46:16.595261 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:46:16.600096 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6c7561b5-f181-406c-9780-6b452b7fd06a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:46:16.600661 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6c7561b5-f181-406c-9780-6b452b7fd06a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:46:16.601504 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6c7561b5-f181-406c-9780-6b452b7fd06a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:46:16.601939 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6c7561b5-f181-406c-9780-6b452b7fd06a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:46:17.450503 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-6c7561b5-f181-406c-9780-6b452b7fd06a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "POST /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.864184 Jun 07 08:46:17.451596 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 416/824] 10.222.0.17 () {60 vars in 1322 bytes} [Tue Jun 7 08:46:16 2022] POST /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22/os-volume_attachments => generated 194 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:46:24.969770 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-77b95cdc-a845-48b2-a9f2-26f9fb574083 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Action: 'create', calling method: .version_select at 0x7f7fefca15e0>, body: {"keypair": {"name": "tempest-keypair-1090236951", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAheqTwB28QmfEZgROcIp/heq0P30KTa0zEGh/trfXRALlE1dDzhLSUeiLAYuHRqYCLuFcjsVouG1gbl91FZ7Gf//EoEg71AKZCm4aS8sKuENlCCXN0xGlmU1EnGxGL8Q=="}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:46:24.987082 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-77b95cdc-a845-48b2-a9f2-26f9fb574083 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Getting quotas for project 0899cad1b7c64a0199b3466d4c7cfefb. Resources: {'key_pairs'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 08:46:24.990996 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-77b95cdc-a845-48b2-a9f2-26f9fb574083 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Getting quotas for user 52ddf59fe764404eb1c6ee745e21d352 and project 0899cad1b7c64a0199b3466d4c7cfefb. Resources: {'key_pairs'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 08:46:25.128844 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-77b95cdc-a845-48b2-a9f2-26f9fb574083 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.163409 Jun 07 08:46:25.129492 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 409/825] 10.222.0.17 () {60 vars in 1158 bytes} [Tue Jun 7 08:46:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:46:27.495359 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-f208845f-1064-434c-b8b4-95f010a64478 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-351372051", "imageRef": "c04b0a92-7675-47c3-bcc2-8a2a59b997c3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "887f6fc8-6e65-421d-990a-570b64e04d42"}], "security_groups": [{"name": "tempest-securitygroup--2003570648"}], "key_name": "tempest-keypair-1090236951", "user_data": "}} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:46:27.505854 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_api:SELECT=2 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:46:27.506438 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:46:27.644426 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.network.neutron [None req-f208845f-1064-434c-b8b4-95f010a64478 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] validate_networks() for [('887f6fc8-6e65-421d-990a-570b64e04d42', None, None, None, None, None)] {{(pid=129725) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 08:46:28.389739 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-f208845f-1064-434c-b8b4-95f010a64478 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Flavor limits 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 08:46:28.390394 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-f208845f-1064-434c-b8b4-95f010a64478 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Image limits 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 08:46:28.391714 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-f208845f-1064-434c-b8b4-95f010a64478 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Flavor pref 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 08:46:28.392355 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-f208845f-1064-434c-b8b4-95f010a64478 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Image pref 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 08:46:28.393331 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-f208845f-1064-434c-b8b4-95f010a64478 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 08:46:28.406316 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f208845f-1064-434c-b8b4-95f010a64478 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:46:28.407049 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f208845f-1064-434c-b8b4-95f010a64478 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:46:28.408299 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f208845f-1064-434c-b8b4-95f010a64478 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:46:28.409052 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f208845f-1064-434c-b8b4-95f010a64478 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:46:28.434163 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.quota [None req-f208845f-1064-434c-b8b4-95f010a64478 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Getting quotas for project 0899cad1b7c64a0199b3466d4c7cfefb. Resources: {'ram', 'cores', 'instances'} {{(pid=129725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 08:46:28.440579 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.quota [None req-f208845f-1064-434c-b8b4-95f010a64478 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Getting quotas for user 52ddf59fe764404eb1c6ee745e21d352 and project 0899cad1b7c64a0199b3466d4c7cfefb. Resources: {'ram', 'cores', 'instances'} {{(pid=129725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 08:46:28.457191 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-f208845f-1064-434c-b8b4-95f010a64478 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Going to run 1 instances... {{(pid=129725) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 08:46:28.460980 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-f208845f-1064-434c-b8b4-95f010a64478 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c04b0a92-7675-47c3-bcc2-8a2a59b997c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 08:46:28.655567 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-f208845f-1064-434c-b8b4-95f010a64478 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.165723 Jun 07 08:46:28.657265 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 417/826] 10.222.0.17 () {60 vars in 1146 bytes} [Tue Jun 7 08:46:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 1169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 08:46:28.668164 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-e4acab5e-f71a-481c-80e7-0abbeaa8e8c5 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:46:28.669043 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-e4acab5e-f71a-481c-80e7-0abbeaa8e8c5 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:46:28.737722 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-e4acab5e-f71a-481c-80e7-0abbeaa8e8c5 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:46:28.745037 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-e4acab5e-f71a-481c-80e7-0abbeaa8e8c5 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1" status: 200 len: 1241 microversion: 2.1 time: 0.081247 Jun 07 08:46:28.745589 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 410/827] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:46:28 2022] GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:46:29.764132 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-77f32df9-2320-4cba-9f43-6175b52e9908 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:46:29.764745 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-77f32df9-2320-4cba-9f43-6175b52e9908 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:46:29.773950 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-77f32df9-2320-4cba-9f43-6175b52e9908 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:46:29.775279 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-77f32df9-2320-4cba-9f43-6175b52e9908 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:46:29.776188 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-77f32df9-2320-4cba-9f43-6175b52e9908 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:46:29.776626 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-77f32df9-2320-4cba-9f43-6175b52e9908 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:46:29.844062 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-77f32df9-2320-4cba-9f43-6175b52e9908 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:46:29.853348 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-77f32df9-2320-4cba-9f43-6175b52e9908 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1" status: 200 len: 1245 microversion: 2.1 time: 0.093296 Jun 07 08:46:29.853924 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 418/828] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:46:29 2022] GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:46:30.871557 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-6fe2ba42-a159-4086-869e-099ad7498e5e tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:46:30.872341 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-6fe2ba42-a159-4086-869e-099ad7498e5e tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:46:30.880265 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6fe2ba42-a159-4086-869e-099ad7498e5e tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:46:30.880724 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6fe2ba42-a159-4086-869e-099ad7498e5e tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:46:30.881574 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6fe2ba42-a159-4086-869e-099ad7498e5e tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:46:30.882012 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6fe2ba42-a159-4086-869e-099ad7498e5e tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:46:30.950487 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-6fe2ba42-a159-4086-869e-099ad7498e5e tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:46:30.958570 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-6fe2ba42-a159-4086-869e-099ad7498e5e tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1" status: 200 len: 1301 microversion: 2.1 time: 0.091702 Jun 07 08:46:30.959145 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 411/829] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:46:30 2022] GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 => generated 1301 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:46:31.990467 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-e9682843-44d2-4f1a-bd3b-d4b86a205ed1 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:46:31.990467 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-e9682843-44d2-4f1a-bd3b-d4b86a205ed1 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:46:31.990467 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e9682843-44d2-4f1a-bd3b-d4b86a205ed1 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:46:31.991451 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e9682843-44d2-4f1a-bd3b-d4b86a205ed1 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:46:31.992225 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e9682843-44d2-4f1a-bd3b-d4b86a205ed1 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:46:31.992898 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e9682843-44d2-4f1a-bd3b-d4b86a205ed1 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:46:32.232511 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-e9682843-44d2-4f1a-bd3b-d4b86a205ed1 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:46:32.245936 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-e9682843-44d2-4f1a-bd3b-d4b86a205ed1 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1" status: 200 len: 1367 microversion: 2.1 time: 0.271972 Jun 07 08:46:32.247602 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 419/830] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:46:31 2022] GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:46:33.010801 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-565fc77d-0ba1-4b78-a62a-b7f87f9fc712 req-ac75aba7-8144-48fe-8936-8343acdc5668 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1", "tag": "6b9ee1fc-dcbc-4996-bbdf-3ab4f7e7d28d"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:46:33.022562 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-565fc77d-0ba1-4b78-a62a-b7f87f9fc712 req-ac75aba7-8144-48fe-8936-8343acdc5668 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:46:33.023005 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-565fc77d-0ba1-4b78-a62a-b7f87f9fc712 req-ac75aba7-8144-48fe-8936-8343acdc5668 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:46:33.039046 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-565fc77d-0ba1-4b78-a62a-b7f87f9fc712 req-ac75aba7-8144-48fe-8936-8343acdc5668 service nova] Creating event network-changed:6b9ee1fc-dcbc-4996-bbdf-3ab4f7e7d28d for instance c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 on hv-cinder-74014 Jun 07 08:46:33.052396 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-565fc77d-0ba1-4b78-a62a-b7f87f9fc712 req-ac75aba7-8144-48fe-8936-8343acdc5668 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045092 Jun 07 08:46:33.053402 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 412/831] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:46:33.272351 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-ab833a0a-a251-444e-aaf1-83fb2861bb79 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:46:33.278430 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-ab833a0a-a251-444e-aaf1-83fb2861bb79 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:46:33.280709 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ab833a0a-a251-444e-aaf1-83fb2861bb79 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:46:33.281191 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ab833a0a-a251-444e-aaf1-83fb2861bb79 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:46:33.282589 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ab833a0a-a251-444e-aaf1-83fb2861bb79 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:46:33.283031 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ab833a0a-a251-444e-aaf1-83fb2861bb79 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:46:33.497135 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-ab833a0a-a251-444e-aaf1-83fb2861bb79 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:46:33.511557 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-ab833a0a-a251-444e-aaf1-83fb2861bb79 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1" status: 200 len: 1367 microversion: 2.1 time: 0.242628 Jun 07 08:46:33.512692 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 420/832] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:46:33 2022] GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:46:34.533061 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-e658c2bf-1ce3-4ea5-83de-f8b06d488593 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:46:34.534014 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-e658c2bf-1ce3-4ea5-83de-f8b06d488593 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:46:34.542678 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e658c2bf-1ce3-4ea5-83de-f8b06d488593 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:46:34.543119 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e658c2bf-1ce3-4ea5-83de-f8b06d488593 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:46:34.543890 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e658c2bf-1ce3-4ea5-83de-f8b06d488593 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:46:34.544321 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e658c2bf-1ce3-4ea5-83de-f8b06d488593 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:46:34.682547 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-e658c2bf-1ce3-4ea5-83de-f8b06d488593 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:46:34.690209 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-e658c2bf-1ce3-4ea5-83de-f8b06d488593 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1" status: 200 len: 1367 microversion: 2.1 time: 0.163769 Jun 07 08:46:34.690786 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 413/833] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:46:34 2022] GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:46:35.707225 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-2391ba83-3c16-48f0-bfd8-972c34000a2b tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:46:35.707836 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-2391ba83-3c16-48f0-bfd8-972c34000a2b tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:46:35.714281 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2391ba83-3c16-48f0-bfd8-972c34000a2b tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:46:35.714723 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2391ba83-3c16-48f0-bfd8-972c34000a2b tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:46:35.715478 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2391ba83-3c16-48f0-bfd8-972c34000a2b tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:46:35.715907 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2391ba83-3c16-48f0-bfd8-972c34000a2b tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:46:35.855556 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-2391ba83-3c16-48f0-bfd8-972c34000a2b tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:46:35.864165 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-2391ba83-3c16-48f0-bfd8-972c34000a2b tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1" status: 200 len: 1367 microversion: 2.1 time: 0.160829 Jun 07 08:46:35.864762 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 421/834] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:46:35 2022] GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:46:36.882840 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-d162ab36-88d5-4e3b-9607-6eb1b8b8bc7f tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:46:36.884100 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-d162ab36-88d5-4e3b-9607-6eb1b8b8bc7f tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:46:36.890398 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d162ab36-88d5-4e3b-9607-6eb1b8b8bc7f tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:46:36.890894 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d162ab36-88d5-4e3b-9607-6eb1b8b8bc7f tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:46:36.891683 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d162ab36-88d5-4e3b-9607-6eb1b8b8bc7f tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:46:36.892129 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d162ab36-88d5-4e3b-9607-6eb1b8b8bc7f tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:46:37.032806 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-d162ab36-88d5-4e3b-9607-6eb1b8b8bc7f tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:46:37.043052 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-d162ab36-88d5-4e3b-9607-6eb1b8b8bc7f tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1" status: 200 len: 1367 microversion: 2.1 time: 0.164195 Jun 07 08:46:37.043864 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 414/835] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:46:36 2022] GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:46:38.061218 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-68cd58c3-ba57-498a-abce-cb356917ad38 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:46:38.062055 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-68cd58c3-ba57-498a-abce-cb356917ad38 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:46:38.071028 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-68cd58c3-ba57-498a-abce-cb356917ad38 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:46:38.071465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-68cd58c3-ba57-498a-abce-cb356917ad38 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:46:38.072441 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-68cd58c3-ba57-498a-abce-cb356917ad38 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:46:38.073082 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-68cd58c3-ba57-498a-abce-cb356917ad38 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:46:38.182010 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-21bffa84-9b60-4634-818a-343cae8acc4a req-55b169bf-76ff-45c9-88e9-71abbc2ecbac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1", "name": "network-vif-plugged", "status": "completed", "tag": "6b9ee1fc-dcbc-4996-bbdf-3ab4f7e7d28d"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:46:38.192106 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-21bffa84-9b60-4634-818a-343cae8acc4a req-55b169bf-76ff-45c9-88e9-71abbc2ecbac service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:46:38.192561 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-21bffa84-9b60-4634-818a-343cae8acc4a req-55b169bf-76ff-45c9-88e9-71abbc2ecbac service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:46:38.204867 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-21bffa84-9b60-4634-818a-343cae8acc4a req-55b169bf-76ff-45c9-88e9-71abbc2ecbac service nova] Creating event network-vif-plugged:6b9ee1fc-dcbc-4996-bbdf-3ab4f7e7d28d for instance c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 on hv-cinder-74014 Jun 07 08:46:38.212416 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-21bffa84-9b60-4634-818a-343cae8acc4a req-55b169bf-76ff-45c9-88e9-71abbc2ecbac service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034347 Jun 07 08:46:38.213073 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 415/836] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:46:38.248832 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-68cd58c3-ba57-498a-abce-cb356917ad38 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:46:38.257912 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-68cd58c3-ba57-498a-abce-cb356917ad38 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1" status: 200 len: 1367 microversion: 2.1 time: 0.200646 Jun 07 08:46:38.258676 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 422/837] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:46:38 2022] GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:46:39.284667 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-1d3ead6b-791e-4e97-a577-c1f2f27b8913 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:46:39.285313 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-1d3ead6b-791e-4e97-a577-c1f2f27b8913 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:46:39.287242 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell0:SELECT=6 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:46:39.292855 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1d3ead6b-791e-4e97-a577-c1f2f27b8913 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:46:39.293353 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1d3ead6b-791e-4e97-a577-c1f2f27b8913 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:46:39.296374 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1d3ead6b-791e-4e97-a577-c1f2f27b8913 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:46:39.296374 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1d3ead6b-791e-4e97-a577-c1f2f27b8913 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:46:39.428495 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-1d3ead6b-791e-4e97-a577-c1f2f27b8913 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:46:39.436745 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-1d3ead6b-791e-4e97-a577-c1f2f27b8913 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1" status: 200 len: 1367 microversion: 2.1 time: 0.156877 Jun 07 08:46:39.437356 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 416/838] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:46:39 2022] GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:46:40.451294 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell0:SELECT=2 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:46:40.452001 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell0:SELECT=6 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:46:40.457505 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-b491c925-cd3e-49ab-bc55-e4aba7310e1d tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:46:40.458127 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-b491c925-cd3e-49ab-bc55-e4aba7310e1d tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:46:40.464442 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b491c925-cd3e-49ab-bc55-e4aba7310e1d tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:46:40.464894 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b491c925-cd3e-49ab-bc55-e4aba7310e1d tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:46:40.465715 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b491c925-cd3e-49ab-bc55-e4aba7310e1d tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:46:40.466135 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b491c925-cd3e-49ab-bc55-e4aba7310e1d tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:46:40.610117 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-b491c925-cd3e-49ab-bc55-e4aba7310e1d tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:46:40.617705 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-b491c925-cd3e-49ab-bc55-e4aba7310e1d tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1" status: 200 len: 1558 microversion: 2.1 time: 0.167229 Jun 07 08:46:40.618273 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 423/839] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:46:40 2022] GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:46:40.636752 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-b3e75d4c-9f65-435c-8408-86cd56267461 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:46:40.637335 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-b3e75d4c-9f65-435c-8408-86cd56267461 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:46:40.643963 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b3e75d4c-9f65-435c-8408-86cd56267461 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:46:40.644408 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b3e75d4c-9f65-435c-8408-86cd56267461 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:46:40.645366 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b3e75d4c-9f65-435c-8408-86cd56267461 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:46:40.645799 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b3e75d4c-9f65-435c-8408-86cd56267461 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:46:40.727338 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-b3e75d4c-9f65-435c-8408-86cd56267461 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096010 Jun 07 08:46:40.727954 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 417/840] 10.222.0.17 () {58 vars in 1274 bytes} [Tue Jun 7 08:46:40 2022] GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:46:41.782516 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-ac6ba53a-8738-4924-90d6-53bfe9754f9f req-e79424d1-f105-4406-8d8c-1e21f7963b3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1", "tag": "6b9ee1fc-dcbc-4996-bbdf-3ab4f7e7d28d"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:46:41.791295 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-ac6ba53a-8738-4924-90d6-53bfe9754f9f req-e79424d1-f105-4406-8d8c-1e21f7963b3e service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:46:41.791740 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-ac6ba53a-8738-4924-90d6-53bfe9754f9f req-e79424d1-f105-4406-8d8c-1e21f7963b3e service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:46:41.803396 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-ac6ba53a-8738-4924-90d6-53bfe9754f9f req-e79424d1-f105-4406-8d8c-1e21f7963b3e service nova] Creating event network-changed:6b9ee1fc-dcbc-4996-bbdf-3ab4f7e7d28d for instance c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 on hv-cinder-74014 Jun 07 08:46:41.808739 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-ac6ba53a-8738-4924-90d6-53bfe9754f9f req-e79424d1-f105-4406-8d8c-1e21f7963b3e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030676 Jun 07 08:46:41.809664 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 424/841] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:47:02.937208 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:47:02.937969 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=36 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:47:02.941867 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-b2220d19-7423-4a05-ab0b-7b8ec8c624b3 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:47:02.945270 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-b2220d19-7423-4a05-ab0b-7b8ec8c624b3 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:02.948516 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b2220d19-7423-4a05-ab0b-7b8ec8c624b3 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:02.948972 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b2220d19-7423-4a05-ab0b-7b8ec8c624b3 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:02.949898 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b2220d19-7423-4a05-ab0b-7b8ec8c624b3 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:02.950433 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b2220d19-7423-4a05-ab0b-7b8ec8c624b3 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:02.973577 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.objects.instance [None req-b2220d19-7423-4a05-ab0b-7b8ec8c624b3 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lazy-loading 'flavor' on Instance uuid cb70e18b-43bf-402d-9d70-028908bfc7fd {{(pid=129726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:47:03.336171 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-b2220d19-7423-4a05-ab0b-7b8ec8c624b3 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "POST /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd/action" status: 202 len: 0 microversion: 2.1 time: 0.400084 Jun 07 08:47:03.340507 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 418/842] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jun 7 08:47:02 2022] POST /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 08:47:03.344066 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:47:03.345129 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=40 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:47:03.349391 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-2826f257-4559-45d5-bc07-833d5c36bf50 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:03.350160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-2826f257-4559-45d5-bc07-833d5c36bf50 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:03.356876 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2826f257-4559-45d5-bc07-833d5c36bf50 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:03.357409 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2826f257-4559-45d5-bc07-833d5c36bf50 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:03.358274 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2826f257-4559-45d5-bc07-833d5c36bf50 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:03.358715 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2826f257-4559-45d5-bc07-833d5c36bf50 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:03.497717 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-2826f257-4559-45d5-bc07-833d5c36bf50 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:03.505065 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-2826f257-4559-45d5-bc07-833d5c36bf50 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1569 microversion: 2.1 time: 0.162624 Jun 07 08:47:03.505614 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 425/843] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:03 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:47:04.524677 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-d2a23b38-cf5f-4b0b-a90b-56f4cc0a458a tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:04.525296 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-d2a23b38-cf5f-4b0b-a90b-56f4cc0a458a tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:04.532786 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d2a23b38-cf5f-4b0b-a90b-56f4cc0a458a tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:04.533293 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d2a23b38-cf5f-4b0b-a90b-56f4cc0a458a tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:04.534068 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d2a23b38-cf5f-4b0b-a90b-56f4cc0a458a tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:04.534529 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d2a23b38-cf5f-4b0b-a90b-56f4cc0a458a tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:04.754465 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-d2a23b38-cf5f-4b0b-a90b-56f4cc0a458a tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:04.762270 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-d2a23b38-cf5f-4b0b-a90b-56f4cc0a458a tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1569 microversion: 2.1 time: 0.242495 Jun 07 08:47:04.762857 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 419/844] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:04 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1569 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:05.779916 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-f7730cd0-0a94-44fd-af01-0c6588d54e5a tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:05.780726 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-f7730cd0-0a94-44fd-af01-0c6588d54e5a tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:05.787982 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f7730cd0-0a94-44fd-af01-0c6588d54e5a tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:05.788430 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f7730cd0-0a94-44fd-af01-0c6588d54e5a tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:05.789224 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f7730cd0-0a94-44fd-af01-0c6588d54e5a tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:05.789658 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f7730cd0-0a94-44fd-af01-0c6588d54e5a tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:05.924805 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-f7730cd0-0a94-44fd-af01-0c6588d54e5a tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:05.937068 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-f7730cd0-0a94-44fd-af01-0c6588d54e5a tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1569 microversion: 2.1 time: 0.157727 Jun 07 08:47:05.937068 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 426/845] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:05 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:06.949685 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-aa70d7f0-27f6-4f32-818a-61d4800bac38 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:06.950297 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-aa70d7f0-27f6-4f32-818a-61d4800bac38 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:06.957015 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-aa70d7f0-27f6-4f32-818a-61d4800bac38 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:06.957468 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-aa70d7f0-27f6-4f32-818a-61d4800bac38 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:06.958222 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-aa70d7f0-27f6-4f32-818a-61d4800bac38 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:06.958652 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-aa70d7f0-27f6-4f32-818a-61d4800bac38 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:07.043734 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-82514301-9734-414f-ae6c-bb27c844140b tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1841060434", "imageRef": "c04b0a92-7675-47c3-bcc2-8a2a59b997c3", "flavorRef": "452", "networks": [{"uuid": "fcce195b-6407-4d12-9ce4-532cb336c938"}]}} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:47:07.100083 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-aa70d7f0-27f6-4f32-818a-61d4800bac38 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:07.100271 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.network.neutron [None req-82514301-9734-414f-ae6c-bb27c844140b tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] validate_networks() for [('fcce195b-6407-4d12-9ce4-532cb336c938', None, None, None, None, None)] {{(pid=129725) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 08:47:07.103076 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-aa70d7f0-27f6-4f32-818a-61d4800bac38 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1569 microversion: 2.1 time: 0.157078 Jun 07 08:47:07.104132 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 420/846] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:06 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:07.449942 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-82514301-9734-414f-ae6c-bb27c844140b tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Flavor limits 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 08:47:07.450365 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-82514301-9734-414f-ae6c-bb27c844140b tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Image limits 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 08:47:07.450836 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-82514301-9734-414f-ae6c-bb27c844140b tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Flavor pref 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 08:47:07.451354 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-82514301-9734-414f-ae6c-bb27c844140b tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Image pref 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 08:47:07.452246 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-82514301-9734-414f-ae6c-bb27c844140b tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 08:47:07.461133 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-82514301-9734-414f-ae6c-bb27c844140b tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:07.461518 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-82514301-9734-414f-ae6c-bb27c844140b tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:07.462307 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-82514301-9734-414f-ae6c-bb27c844140b tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:07.462740 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-82514301-9734-414f-ae6c-bb27c844140b tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:07.479791 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.quota [None req-82514301-9734-414f-ae6c-bb27c844140b tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Getting quotas for project 287c3c3374034e3899d7c8b7d970a738. Resources: {'ram', 'cores', 'instances'} {{(pid=129725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 08:47:07.484263 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.quota [None req-82514301-9734-414f-ae6c-bb27c844140b tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Getting quotas for user 03c3d3030c6a4d42a941ae489c5bf125 and project 287c3c3374034e3899d7c8b7d970a738. Resources: {'ram', 'cores', 'instances'} {{(pid=129725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 08:47:07.495128 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-82514301-9734-414f-ae6c-bb27c844140b tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Going to run 1 instances... {{(pid=129725) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 08:47:07.497579 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-82514301-9734-414f-ae6c-bb27c844140b tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: 09a4d297-6aca-4a31-b0c5-25d8fb05af30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c04b0a92-7675-47c3-bcc2-8a2a59b997c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 08:47:07.629904 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-82514301-9734-414f-ae6c-bb27c844140b tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.589908 Jun 07 08:47:07.630552 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 427/847] 10.222.0.17 () {60 vars in 1146 bytes} [Tue Jun 7 08:47:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 08:47:07.640862 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-ffd313f9-6d9e-4ce7-b1ce-e71e9fa0f98d tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:07.643238 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-ffd313f9-6d9e-4ce7-b1ce-e71e9fa0f98d tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: 09a4d297-6aca-4a31-b0c5-25d8fb05af30] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:07.699889 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-ffd313f9-6d9e-4ce7-b1ce-e71e9fa0f98d tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c3d3030c6a4d42a941ae489c5bf125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287c3c3374034e3899d7c8b7d970a738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:07.707510 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-ffd313f9-6d9e-4ce7-b1ce-e71e9fa0f98d tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30" status: 200 len: 1219 microversion: 2.1 time: 0.070884 Jun 07 08:47:07.708133 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 421/848] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:07 2022] GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:47:08.120187 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-f4f981fb-550e-423e-8c15-9013c0410e3a tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:08.120793 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-f4f981fb-550e-423e-8c15-9013c0410e3a tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:08.127285 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f4f981fb-550e-423e-8c15-9013c0410e3a tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:08.127750 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f4f981fb-550e-423e-8c15-9013c0410e3a tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:08.128536 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f4f981fb-550e-423e-8c15-9013c0410e3a tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:08.128955 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f4f981fb-550e-423e-8c15-9013c0410e3a tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:08.262159 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-f4f981fb-550e-423e-8c15-9013c0410e3a tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:08.270228 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-f4f981fb-550e-423e-8c15-9013c0410e3a tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1569 microversion: 2.1 time: 0.154451 Jun 07 08:47:08.270793 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 428/849] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:08 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:08.723725 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-c8ea3824-3aa8-4597-8a96-61c95a129995 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:08.724343 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-c8ea3824-3aa8-4597-8a96-61c95a129995 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: 09a4d297-6aca-4a31-b0c5-25d8fb05af30] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:08.731282 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c8ea3824-3aa8-4597-8a96-61c95a129995 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:08.731739 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c8ea3824-3aa8-4597-8a96-61c95a129995 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:08.733106 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c8ea3824-3aa8-4597-8a96-61c95a129995 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:08.733553 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c8ea3824-3aa8-4597-8a96-61c95a129995 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:08.796391 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-c8ea3824-3aa8-4597-8a96-61c95a129995 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c3d3030c6a4d42a941ae489c5bf125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287c3c3374034e3899d7c8b7d970a738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:08.804718 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-c8ea3824-3aa8-4597-8a96-61c95a129995 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30" status: 200 len: 1223 microversion: 2.1 time: 0.084268 Jun 07 08:47:08.804718 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 422/850] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:08 2022] GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:09.288368 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-fce98927-d102-4528-8ef8-c34733280ba9 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:09.288976 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-fce98927-d102-4528-8ef8-c34733280ba9 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:09.296134 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-fce98927-d102-4528-8ef8-c34733280ba9 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:09.296575 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-fce98927-d102-4528-8ef8-c34733280ba9 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:09.297365 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-fce98927-d102-4528-8ef8-c34733280ba9 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:09.297800 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-fce98927-d102-4528-8ef8-c34733280ba9 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:09.449612 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-fce98927-d102-4528-8ef8-c34733280ba9 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:09.457872 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-fce98927-d102-4528-8ef8-c34733280ba9 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1569 microversion: 2.1 time: 0.173306 Jun 07 08:47:09.458451 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 429/851] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:09 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:09.822258 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-08242d68-1299-4391-a3bc-7c5e17b9e438 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:09.822797 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-08242d68-1299-4391-a3bc-7c5e17b9e438 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: 09a4d297-6aca-4a31-b0c5-25d8fb05af30] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:09.829784 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-08242d68-1299-4391-a3bc-7c5e17b9e438 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:09.830234 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-08242d68-1299-4391-a3bc-7c5e17b9e438 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:09.831006 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-08242d68-1299-4391-a3bc-7c5e17b9e438 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:09.831443 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-08242d68-1299-4391-a3bc-7c5e17b9e438 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:09.902380 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-08242d68-1299-4391-a3bc-7c5e17b9e438 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c3d3030c6a4d42a941ae489c5bf125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287c3c3374034e3899d7c8b7d970a738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:09.910791 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-08242d68-1299-4391-a3bc-7c5e17b9e438 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30" status: 200 len: 1277 microversion: 2.1 time: 0.092764 Jun 07 08:47:09.911380 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 423/852] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:09 2022] GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30 => generated 1277 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:10.475610 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-96715dc6-8e94-4602-8a0d-2d547f2b1e3d tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:10.476215 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-96715dc6-8e94-4602-8a0d-2d547f2b1e3d tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:10.482722 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-96715dc6-8e94-4602-8a0d-2d547f2b1e3d tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:10.483169 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-96715dc6-8e94-4602-8a0d-2d547f2b1e3d tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:10.483935 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-96715dc6-8e94-4602-8a0d-2d547f2b1e3d tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:10.484369 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-96715dc6-8e94-4602-8a0d-2d547f2b1e3d tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:10.644233 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-96715dc6-8e94-4602-8a0d-2d547f2b1e3d tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:10.651862 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-96715dc6-8e94-4602-8a0d-2d547f2b1e3d tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1569 microversion: 2.1 time: 0.180048 Jun 07 08:47:10.652682 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 430/853] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:10 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:10.927837 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-15fb4a82-18b1-4c18-9725-21d993c8ce7e tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:10.929260 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-15fb4a82-18b1-4c18-9725-21d993c8ce7e tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: 09a4d297-6aca-4a31-b0c5-25d8fb05af30] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:10.936694 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-15fb4a82-18b1-4c18-9725-21d993c8ce7e tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:10.937187 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-15fb4a82-18b1-4c18-9725-21d993c8ce7e tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:10.938082 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-15fb4a82-18b1-4c18-9725-21d993c8ce7e tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:10.938934 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-15fb4a82-18b1-4c18-9725-21d993c8ce7e tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:11.079369 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-15fb4a82-18b1-4c18-9725-21d993c8ce7e tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c3d3030c6a4d42a941ae489c5bf125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287c3c3374034e3899d7c8b7d970a738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:11.087858 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-15fb4a82-18b1-4c18-9725-21d993c8ce7e tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30" status: 200 len: 1319 microversion: 2.1 time: 0.163980 Jun 07 08:47:11.088443 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 424/854] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:10 2022] GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:11.543358 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-203d626d-20ba-4c08-8148-f2ea3cbf248b req-7835be77-a609-4abe-9737-081ce0f701b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09a4d297-6aca-4a31-b0c5-25d8fb05af30", "tag": "c8e2855e-c2c9-4dd2-8502-7dedb744855c"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:47:11.553721 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-203d626d-20ba-4c08-8148-f2ea3cbf248b req-7835be77-a609-4abe-9737-081ce0f701b4 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:11.554323 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-203d626d-20ba-4c08-8148-f2ea3cbf248b req-7835be77-a609-4abe-9737-081ce0f701b4 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:11.569521 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-203d626d-20ba-4c08-8148-f2ea3cbf248b req-7835be77-a609-4abe-9737-081ce0f701b4 service nova] Creating event network-changed:c8e2855e-c2c9-4dd2-8502-7dedb744855c for instance 09a4d297-6aca-4a31-b0c5-25d8fb05af30 on hv-cinder-74014 Jun 07 08:47:11.574855 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-203d626d-20ba-4c08-8148-f2ea3cbf248b req-7835be77-a609-4abe-9737-081ce0f701b4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035321 Jun 07 08:47:11.575456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 431/855] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:47:11.670189 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-896b4874-0aea-4f29-b2e2-5fcd59478a36 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:11.670805 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-896b4874-0aea-4f29-b2e2-5fcd59478a36 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:11.677008 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-896b4874-0aea-4f29-b2e2-5fcd59478a36 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:11.677699 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-896b4874-0aea-4f29-b2e2-5fcd59478a36 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:11.678473 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-896b4874-0aea-4f29-b2e2-5fcd59478a36 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:11.678905 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-896b4874-0aea-4f29-b2e2-5fcd59478a36 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:11.817339 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-896b4874-0aea-4f29-b2e2-5fcd59478a36 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:11.825309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-896b4874-0aea-4f29-b2e2-5fcd59478a36 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1569 microversion: 2.1 time: 0.159037 Jun 07 08:47:11.825906 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 425/856] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:11 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:12.106190 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-f4567666-e18b-4515-a507-c06bc963af9e tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:12.106971 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-f4567666-e18b-4515-a507-c06bc963af9e tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: 09a4d297-6aca-4a31-b0c5-25d8fb05af30] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:12.114039 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f4567666-e18b-4515-a507-c06bc963af9e tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:12.114489 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f4567666-e18b-4515-a507-c06bc963af9e tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:12.115257 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f4567666-e18b-4515-a507-c06bc963af9e tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:12.116022 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f4567666-e18b-4515-a507-c06bc963af9e tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:12.333060 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-f4567666-e18b-4515-a507-c06bc963af9e tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c3d3030c6a4d42a941ae489c5bf125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287c3c3374034e3899d7c8b7d970a738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:12.340903 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-f4567666-e18b-4515-a507-c06bc963af9e tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30" status: 200 len: 1319 microversion: 2.1 time: 0.239110 Jun 07 08:47:12.341509 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 432/857] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:12 2022] GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30 => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:12.844085 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-80967625-0bf3-4f9d-bebf-f65f6d7e05db tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:12.844724 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-80967625-0bf3-4f9d-bebf-f65f6d7e05db tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:12.851230 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-80967625-0bf3-4f9d-bebf-f65f6d7e05db tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:12.851677 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-80967625-0bf3-4f9d-bebf-f65f6d7e05db tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:12.852433 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-80967625-0bf3-4f9d-bebf-f65f6d7e05db tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:12.852865 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-80967625-0bf3-4f9d-bebf-f65f6d7e05db tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:12.987225 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-80967625-0bf3-4f9d-bebf-f65f6d7e05db tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:12.994753 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-80967625-0bf3-4f9d-bebf-f65f6d7e05db tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1569 microversion: 2.1 time: 0.155051 Jun 07 08:47:12.995316 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 426/858] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:12 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:13.358443 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-e341a7e2-8d3e-4101-b97d-9a5173d531b2 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:13.359054 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-e341a7e2-8d3e-4101-b97d-9a5173d531b2 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: 09a4d297-6aca-4a31-b0c5-25d8fb05af30] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:13.365608 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e341a7e2-8d3e-4101-b97d-9a5173d531b2 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:13.366053 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e341a7e2-8d3e-4101-b97d-9a5173d531b2 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:13.366812 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e341a7e2-8d3e-4101-b97d-9a5173d531b2 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:13.367241 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e341a7e2-8d3e-4101-b97d-9a5173d531b2 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:13.497345 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-e341a7e2-8d3e-4101-b97d-9a5173d531b2 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c3d3030c6a4d42a941ae489c5bf125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287c3c3374034e3899d7c8b7d970a738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:13.504791 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-e341a7e2-8d3e-4101-b97d-9a5173d531b2 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30" status: 200 len: 1319 microversion: 2.1 time: 0.150897 Jun 07 08:47:13.505654 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 433/859] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:13 2022] GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:14.011760 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-119009dd-7e6f-4a1e-b817-0a545456334b tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:14.012302 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-119009dd-7e6f-4a1e-b817-0a545456334b tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:14.019551 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-119009dd-7e6f-4a1e-b817-0a545456334b tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:14.023251 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-119009dd-7e6f-4a1e-b817-0a545456334b tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:14.023251 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-119009dd-7e6f-4a1e-b817-0a545456334b tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:14.023251 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-119009dd-7e6f-4a1e-b817-0a545456334b tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:14.169228 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-119009dd-7e6f-4a1e-b817-0a545456334b tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:14.185091 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-119009dd-7e6f-4a1e-b817-0a545456334b tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1569 microversion: 2.1 time: 0.176997 Jun 07 08:47:14.198384 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 427/860] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:14 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:14.523087 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-dd71f98d-823d-41bd-8529-1fcfc3901398 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:14.523808 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-dd71f98d-823d-41bd-8529-1fcfc3901398 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: 09a4d297-6aca-4a31-b0c5-25d8fb05af30] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:14.531629 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-dd71f98d-823d-41bd-8529-1fcfc3901398 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:14.532107 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-dd71f98d-823d-41bd-8529-1fcfc3901398 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:14.532879 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-dd71f98d-823d-41bd-8529-1fcfc3901398 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:14.533428 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-dd71f98d-823d-41bd-8529-1fcfc3901398 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:14.662980 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-dd71f98d-823d-41bd-8529-1fcfc3901398 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c3d3030c6a4d42a941ae489c5bf125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287c3c3374034e3899d7c8b7d970a738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:14.670546 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-dd71f98d-823d-41bd-8529-1fcfc3901398 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30" status: 200 len: 1319 microversion: 2.1 time: 0.151613 Jun 07 08:47:14.671145 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 434/861] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:14 2022] GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:15.208871 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-86cc2d28-5b82-407c-a810-54dfb12ce0cf tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:15.209529 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-86cc2d28-5b82-407c-a810-54dfb12ce0cf tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:15.215988 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-86cc2d28-5b82-407c-a810-54dfb12ce0cf tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:15.216438 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-86cc2d28-5b82-407c-a810-54dfb12ce0cf tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:15.217821 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-86cc2d28-5b82-407c-a810-54dfb12ce0cf tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:15.218259 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-86cc2d28-5b82-407c-a810-54dfb12ce0cf tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:15.352699 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-86cc2d28-5b82-407c-a810-54dfb12ce0cf tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:15.360713 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-86cc2d28-5b82-407c-a810-54dfb12ce0cf tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1569 microversion: 2.1 time: 0.155726 Jun 07 08:47:15.361320 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 428/862] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:15 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:15.687764 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-1cc97392-97e2-4520-9050-638a820085f6 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:15.688437 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-1cc97392-97e2-4520-9050-638a820085f6 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: 09a4d297-6aca-4a31-b0c5-25d8fb05af30] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:15.694856 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1cc97392-97e2-4520-9050-638a820085f6 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:15.695308 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1cc97392-97e2-4520-9050-638a820085f6 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:15.696070 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1cc97392-97e2-4520-9050-638a820085f6 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:15.696507 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1cc97392-97e2-4520-9050-638a820085f6 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:15.862348 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-1cc97392-97e2-4520-9050-638a820085f6 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c3d3030c6a4d42a941ae489c5bf125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287c3c3374034e3899d7c8b7d970a738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:15.869808 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-1cc97392-97e2-4520-9050-638a820085f6 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30" status: 200 len: 1319 microversion: 2.1 time: 0.186370 Jun 07 08:47:15.870371 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 435/863] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:15 2022] GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:16.377127 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-cf4ef949-2c75-4b8d-8632-ff865baeea8d req-e292c91f-6026-40b0-9319-aacbeb32d2de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09a4d297-6aca-4a31-b0c5-25d8fb05af30", "name": "network-vif-plugged", "status": "completed", "tag": "c8e2855e-c2c9-4dd2-8502-7dedb744855c"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:47:16.386057 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-9e721cfa-1f4a-4629-9000-ceaf7aaf0dd9 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:16.386676 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-9e721cfa-1f4a-4629-9000-ceaf7aaf0dd9 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:16.388227 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-cf4ef949-2c75-4b8d-8632-ff865baeea8d req-e292c91f-6026-40b0-9319-aacbeb32d2de service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:16.388563 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-cf4ef949-2c75-4b8d-8632-ff865baeea8d req-e292c91f-6026-40b0-9319-aacbeb32d2de service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:16.393443 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9e721cfa-1f4a-4629-9000-ceaf7aaf0dd9 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:16.393900 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9e721cfa-1f4a-4629-9000-ceaf7aaf0dd9 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:16.394671 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9e721cfa-1f4a-4629-9000-ceaf7aaf0dd9 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:16.395110 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9e721cfa-1f4a-4629-9000-ceaf7aaf0dd9 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:16.400857 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-cf4ef949-2c75-4b8d-8632-ff865baeea8d req-e292c91f-6026-40b0-9319-aacbeb32d2de service nova] Creating event network-vif-plugged:c8e2855e-c2c9-4dd2-8502-7dedb744855c for instance 09a4d297-6aca-4a31-b0c5-25d8fb05af30 on hv-cinder-74014 Jun 07 08:47:16.406616 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-cf4ef949-2c75-4b8d-8632-ff865baeea8d req-e292c91f-6026-40b0-9319-aacbeb32d2de service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033612 Jun 07 08:47:16.407153 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 429/864] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:47:16.530847 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-9e721cfa-1f4a-4629-9000-ceaf7aaf0dd9 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:16.538822 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-9e721cfa-1f4a-4629-9000-ceaf7aaf0dd9 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1569 microversion: 2.1 time: 0.156675 Jun 07 08:47:16.539406 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 436/865] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:16 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:16.887094 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-9156f843-c6a6-47ee-bcca-bf149f626dad tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:16.887986 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-9156f843-c6a6-47ee-bcca-bf149f626dad tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: 09a4d297-6aca-4a31-b0c5-25d8fb05af30] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:16.895116 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9156f843-c6a6-47ee-bcca-bf149f626dad tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:16.895560 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9156f843-c6a6-47ee-bcca-bf149f626dad tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:16.896333 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9156f843-c6a6-47ee-bcca-bf149f626dad tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:16.896753 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9156f843-c6a6-47ee-bcca-bf149f626dad tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:17.028474 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-9156f843-c6a6-47ee-bcca-bf149f626dad tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c3d3030c6a4d42a941ae489c5bf125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287c3c3374034e3899d7c8b7d970a738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:17.035962 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-9156f843-c6a6-47ee-bcca-bf149f626dad tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30" status: 200 len: 1319 microversion: 2.1 time: 0.153088 Jun 07 08:47:17.036524 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 430/866] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:16 2022] GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:17.556514 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-8d0586af-d8d3-4d46-8b2b-98d421be2307 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:17.557159 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-8d0586af-d8d3-4d46-8b2b-98d421be2307 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:17.559663 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell0:SELECT=2 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:47:17.560338 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell0:SELECT=6 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:47:17.565855 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8d0586af-d8d3-4d46-8b2b-98d421be2307 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:17.566390 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8d0586af-d8d3-4d46-8b2b-98d421be2307 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:17.567156 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8d0586af-d8d3-4d46-8b2b-98d421be2307 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:17.567601 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8d0586af-d8d3-4d46-8b2b-98d421be2307 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:17.699995 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-8d0586af-d8d3-4d46-8b2b-98d421be2307 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:17.708121 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-8d0586af-d8d3-4d46-8b2b-98d421be2307 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1569 microversion: 2.1 time: 0.155541 Jun 07 08:47:17.708680 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 437/867] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:17 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:17.919893 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-1c2aa379-3ef8-4aa2-add9-f4d82b349918 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:17.920441 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-1c2aa379-3ef8-4aa2-add9-f4d82b349918 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:17.922800 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell0:SELECT=2 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:47:17.927615 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1c2aa379-3ef8-4aa2-add9-f4d82b349918 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:17.928060 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1c2aa379-3ef8-4aa2-add9-f4d82b349918 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:17.928923 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1c2aa379-3ef8-4aa2-add9-f4d82b349918 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:17.929445 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1c2aa379-3ef8-4aa2-add9-f4d82b349918 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:17.953984 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-1c2aa379-3ef8-4aa2-add9-f4d82b349918 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1/ips" status: 200 len: 151 microversion: 2.1 time: 0.037950 Jun 07 08:47:17.954852 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 431/868] 10.222.0.17 () {58 vars in 1247 bytes} [Tue Jun 7 08:47:17 2022] GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:47:17.965094 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-d47911e7-e8c4-4adf-b0ea-a667cb138b52 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "135f77aa-86da-40c6-83e4-7c85c0bd6e9c"}} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:47:17.966159 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-d47911e7-e8c4-4adf-b0ea-a667cb138b52 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:17.972725 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d47911e7-e8c4-4adf-b0ea-a667cb138b52 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:17.973233 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d47911e7-e8c4-4adf-b0ea-a667cb138b52 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:17.973998 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d47911e7-e8c4-4adf-b0ea-a667cb138b52 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:17.974435 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d47911e7-e8c4-4adf-b0ea-a667cb138b52 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:18.053121 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-c238916b-e058-486c-a79e-f7c43587f455 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:18.053736 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-c238916b-e058-486c-a79e-f7c43587f455 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: 09a4d297-6aca-4a31-b0c5-25d8fb05af30] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:18.054743 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.wsgi [None req-d47911e7-e8c4-4adf-b0ea-a667cb138b52 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] HTTP exception thrown: Invalid volume: volume 135f77aa-86da-40c6-83e4-7c85c0bd6e9c is already attached to instances: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 Jun 07 08:47:18.056496 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-d47911e7-e8c4-4adf-b0ea-a667cb138b52 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Request method failure captured: Jun 07 08:47:18.056496 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: request: POST /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1/os-volume_attachments HTTP/1.1 Jun 07 08:47:18.056496 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept: application/json Jun 07 08:47:18.056496 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept-Encoding: identity Jun 07 08:47:18.056496 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Connection: close Jun 07 08:47:18.056496 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Length: 74 Jun 07 08:47:18.056496 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Type: application/json Jun 07 08:47:18.056496 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Host: 10.222.0.17 Jun 07 08:47:18.056496 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Openstack-System-Scope: None Jun 07 08:47:18.056496 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: User-Agent: python-urllib3/1.26.9 Jun 07 08:47:18.056496 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Auth-Token: gAAAAABinxAgj5C7ouE1N-aaB4GYPlt92HgnY7l_4qNjeb7MhcXewkqTDq3SwhJjBOupqPwAwi-EUO3Doxu5eOmMdEwFCWQlkuqeuPwgDsRWAIP7QSDJjzl4qrePMCoCSyDT0Sg0QJjM04PVEJfbaffcjJA3z-4CjpQwrMDzvrui6SNaABiQiRQ Jun 07 08:47:18.056496 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Id: None Jun 07 08:47:18.056496 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Name: None Jun 07 08:47:18.056496 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Identity-Status: Confirmed Jun 07 08:47:18.056496 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Is-Admin-Project: True Jun 07 08:47:18.056496 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Id: default Jun 07 08:47:18.056496 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Name: Default Jun 07 08:47:18.056496 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Id: 0899cad1b7c64a0199b3466d4c7cfefb Jun 07 08:47:18.056496 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Name: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:47:18.056496 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Role: reader,member Jun 07 08:47:18.056496 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Roles: reader,member Jun 07 08:47:18.057950 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0899cad1b7c64a0199b3466d4c7cfefb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0899cad1b7c64a0199b3466d4c7cfefb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0899cad1b7c64a0199b3466d4c7cfefb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0899cad1b7c64a0199b3466d4c7cfefb"}]}] Jun 07 08:47:18.057950 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:47:18.057950 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Id: 0899cad1b7c64a0199b3466d4c7cfefb Jun 07 08:47:18.057950 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:47:18.057950 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User: tempest-AttachVolumeNegativeTest-1278776647-project Jun 07 08:47:18.057950 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Id: default Jun 07 08:47:18.057950 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Name: Default Jun 07 08:47:18.057950 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Id: 52ddf59fe764404eb1c6ee745e21d352 Jun 07 08:47:18.057950 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Name: tempest-AttachVolumeNegativeTest-1278776647-project Jun 07 08:47:18.057950 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Jun 07 08:47:18.057950 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {"volumeAttachment": {"volumeId": "135f77aa-86da-40c6-83e4-7c85c0bd6e9c"}} Jun 07 08:47:18.057950 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: method: > Jun 07 08:47:18.058807 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: exception: Invalid volume: volume 135f77aa-86da-40c6-83e4-7c85c0bd6e9c is already attached to instances: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 Jun 07 08:47:18.058807 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: action_args: {'server_id': 'c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1', 'body': {'volumeAttachment': {'volumeId': '135f77aa-86da-40c6-83e4-7c85c0bd6e9c'}}} Jun 07 08:47:18.058807 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:47:18.058807 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:47:18.058807 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 07 08:47:18.058807 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 07 08:47:18.058807 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 08:47:18.058807 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 08:47:18.058807 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 07 08:47:18.058807 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 07 08:47:18.058807 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 07 08:47:18.058807 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 07 08:47:18.058807 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 07 08:47:18.058807 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 07 08:47:18.058807 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 135f77aa-86da-40c6-83e4-7c85c0bd6e9c is already attached to instances: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 Jun 07 08:47:18.058807 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:47:18.058807 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:47:18.058807 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:47:18.058807 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:47:18.060019 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:47:18.060019 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:47:18.060019 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:47:18.060019 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:47:18.060019 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:47:18.060019 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:47:18.060019 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 08:47:18.060019 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 08:47:18.060019 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 08:47:18.060019 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 08:47:18.060019 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 08:47:18.060019 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 08:47:18.060019 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 07 08:47:18.060019 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 07 08:47:18.060019 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 135f77aa-86da-40c6-83e4-7c85c0bd6e9c is already attached to instances: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 Jun 07 08:47:18.060019 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:47:18.060019 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:47:18.060019 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:47:18.060019 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:47:18.060019 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:47:18.061291 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:47:18.061291 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:47:18.061291 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:47:18.061291 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 135f77aa-86da-40c6-83e4-7c85c0bd6e9c is already attached to instances: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 Jun 07 08:47:18.061291 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:47:18.061291 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-d47911e7-e8c4-4adf-b0ea-a667cb138b52 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Returning 400 to user: Invalid volume: volume 135f77aa-86da-40c6-83e4-7c85c0bd6e9c is already attached to instances: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 {{(pid=129725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:47:18.061291 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-d47911e7-e8c4-4adf-b0ea-a667cb138b52 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "POST /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096894 Jun 07 08:47:18.061291 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 438/869] 10.222.0.17 () {60 vars in 1322 bytes} [Tue Jun 7 08:47:17 2022] POST /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 08:47:18.062048 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c238916b-e058-486c-a79e-f7c43587f455 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:18.062048 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c238916b-e058-486c-a79e-f7c43587f455 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:18.062048 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c238916b-e058-486c-a79e-f7c43587f455 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:18.062048 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c238916b-e058-486c-a79e-f7c43587f455 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:18.066259 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-42464d11-2ed7-4d18-a005-ae47893a1ec6 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:18.066753 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-42464d11-2ed7-4d18-a005-ae47893a1ec6 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:18.072757 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-42464d11-2ed7-4d18-a005-ae47893a1ec6 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:18.073252 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-42464d11-2ed7-4d18-a005-ae47893a1ec6 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:18.074051 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-42464d11-2ed7-4d18-a005-ae47893a1ec6 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:18.074485 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-42464d11-2ed7-4d18-a005-ae47893a1ec6 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:18.100039 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-42464d11-2ed7-4d18-a005-ae47893a1ec6 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1] Going to try to terminate instance {{(pid=129725) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 08:47:18.192861 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-c238916b-e058-486c-a79e-f7c43587f455 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c3d3030c6a4d42a941ae489c5bf125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287c3c3374034e3899d7c8b7d970a738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:18.200318 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-c238916b-e058-486c-a79e-f7c43587f455 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30" status: 200 len: 1319 microversion: 2.1 time: 0.150934 Jun 07 08:47:18.200880 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 432/870] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:18 2022] GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:18.359193 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-42464d11-2ed7-4d18-a005-ae47893a1ec6 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1" status: 204 len: 0 microversion: 2.1 time: 0.296014 Jun 07 08:47:18.359778 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 439/871] 10.222.0.17 () {58 vars in 1238 bytes} [Tue Jun 7 08:47:18 2022] DELETE /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 08:47:18.367821 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-284ac26e-df08-4246-8384-57b7bf42c652 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:18.368438 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-284ac26e-df08-4246-8384-57b7bf42c652 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:18.374987 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-284ac26e-df08-4246-8384-57b7bf42c652 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:18.375441 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-284ac26e-df08-4246-8384-57b7bf42c652 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:18.376199 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-284ac26e-df08-4246-8384-57b7bf42c652 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:18.376640 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-284ac26e-df08-4246-8384-57b7bf42c652 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:18.422058 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-4657ca6f-8b62-4951-b43c-97031387d360 req-eb8f11a5-344d-4c62-bb01-fcb773eae45f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb70e18b-43bf-402d-9d70-028908bfc7fd", "name": "network-vif-unplugged", "status": "completed", "tag": "c5b234fe-05ce-4bf2-a2ef-1e4c55770be9"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:47:18.430636 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-4657ca6f-8b62-4951-b43c-97031387d360 req-eb8f11a5-344d-4c62-bb01-fcb773eae45f service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:18.430971 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-4657ca6f-8b62-4951-b43c-97031387d360 req-eb8f11a5-344d-4c62-bb01-fcb773eae45f service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:18.442970 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-4657ca6f-8b62-4951-b43c-97031387d360 req-eb8f11a5-344d-4c62-bb01-fcb773eae45f service nova] Creating event network-vif-unplugged:c5b234fe-05ce-4bf2-a2ef-1e4c55770be9 for instance cb70e18b-43bf-402d-9d70-028908bfc7fd on hv-cinder-74014 Jun 07 08:47:18.447957 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-4657ca6f-8b62-4951-b43c-97031387d360 req-eb8f11a5-344d-4c62-bb01-fcb773eae45f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030544 Jun 07 08:47:18.448575 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 440/872] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:47:18.507562 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-284ac26e-df08-4246-8384-57b7bf42c652 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:18.515573 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-284ac26e-df08-4246-8384-57b7bf42c652 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1" status: 200 len: 1683 microversion: 2.1 time: 0.151546 Jun 07 08:47:18.516136 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 433/873] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:18 2022] GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:18.726871 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-cb32376b-8d12-491a-be09-f36859f32c47 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:18.727622 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-cb32376b-8d12-491a-be09-f36859f32c47 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:18.734970 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-cb32376b-8d12-491a-be09-f36859f32c47 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:18.735453 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-cb32376b-8d12-491a-be09-f36859f32c47 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:18.736219 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-cb32376b-8d12-491a-be09-f36859f32c47 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:18.736653 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-cb32376b-8d12-491a-be09-f36859f32c47 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:18.865743 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-cb32376b-8d12-491a-be09-f36859f32c47 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:18.869386 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:47:18.873914 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-cb32376b-8d12-491a-be09-f36859f32c47 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1569 microversion: 2.1 time: 0.151633 Jun 07 08:47:18.874470 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 441/874] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:18 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:19.222347 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-98b11c29-8f4c-4065-b82f-8fff5c6e41b2 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:19.222957 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-98b11c29-8f4c-4065-b82f-8fff5c6e41b2 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: 09a4d297-6aca-4a31-b0c5-25d8fb05af30] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:19.229437 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-98b11c29-8f4c-4065-b82f-8fff5c6e41b2 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:19.229884 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-98b11c29-8f4c-4065-b82f-8fff5c6e41b2 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:19.230632 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-98b11c29-8f4c-4065-b82f-8fff5c6e41b2 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:19.231062 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-98b11c29-8f4c-4065-b82f-8fff5c6e41b2 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:19.249026 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:47:19.364233 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-98b11c29-8f4c-4065-b82f-8fff5c6e41b2 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c3d3030c6a4d42a941ae489c5bf125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287c3c3374034e3899d7c8b7d970a738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:19.371559 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-98b11c29-8f4c-4065-b82f-8fff5c6e41b2 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30" status: 200 len: 1319 microversion: 2.1 time: 0.153117 Jun 07 08:47:19.372120 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 434/875] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:19 2022] GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:19.538323 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-6fb7ea33-5c09-4425-8405-89ad1ef230db tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:19.538323 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-6fb7ea33-5c09-4425-8405-89ad1ef230db tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:19.540825 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6fb7ea33-5c09-4425-8405-89ad1ef230db tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:19.541306 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6fb7ea33-5c09-4425-8405-89ad1ef230db tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:19.542297 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6fb7ea33-5c09-4425-8405-89ad1ef230db tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:19.542760 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6fb7ea33-5c09-4425-8405-89ad1ef230db tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:19.674182 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-6fb7ea33-5c09-4425-8405-89ad1ef230db tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:19.681783 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-6fb7ea33-5c09-4425-8405-89ad1ef230db tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1" status: 200 len: 1683 microversion: 2.1 time: 0.152421 Jun 07 08:47:19.682369 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 442/876] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:19 2022] GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:19.891954 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-085c1ff9-0bf8-4400-8c6f-92e0ce3df9e6 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:19.892570 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-085c1ff9-0bf8-4400-8c6f-92e0ce3df9e6 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:19.898686 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-085c1ff9-0bf8-4400-8c6f-92e0ce3df9e6 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:19.899133 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-085c1ff9-0bf8-4400-8c6f-92e0ce3df9e6 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:19.899891 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-085c1ff9-0bf8-4400-8c6f-92e0ce3df9e6 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:19.900323 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-085c1ff9-0bf8-4400-8c6f-92e0ce3df9e6 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:20.032460 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-085c1ff9-0bf8-4400-8c6f-92e0ce3df9e6 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:20.040012 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-085c1ff9-0bf8-4400-8c6f-92e0ce3df9e6 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1569 microversion: 2.1 time: 0.152402 Jun 07 08:47:20.040604 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 435/877] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:19 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:20.388247 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-0931e59f-b2c8-4ebf-930d-8db7748f4883 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:20.389376 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-0931e59f-b2c8-4ebf-930d-8db7748f4883 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: 09a4d297-6aca-4a31-b0c5-25d8fb05af30] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:20.396353 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0931e59f-b2c8-4ebf-930d-8db7748f4883 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:20.396780 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0931e59f-b2c8-4ebf-930d-8db7748f4883 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:20.397572 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0931e59f-b2c8-4ebf-930d-8db7748f4883 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:20.398003 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-0931e59f-b2c8-4ebf-930d-8db7748f4883 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:20.530615 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-0931e59f-b2c8-4ebf-930d-8db7748f4883 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c3d3030c6a4d42a941ae489c5bf125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287c3c3374034e3899d7c8b7d970a738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:20.538159 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-0931e59f-b2c8-4ebf-930d-8db7748f4883 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30" status: 200 len: 1319 microversion: 2.1 time: 0.153979 Jun 07 08:47:20.539579 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 443/878] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:20 2022] GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:20.699634 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-5fc9cd2c-ad6e-4ca1-92fe-69c290cfb036 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:20.700253 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-5fc9cd2c-ad6e-4ca1-92fe-69c290cfb036 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:20.707220 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5fc9cd2c-ad6e-4ca1-92fe-69c290cfb036 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:20.707664 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5fc9cd2c-ad6e-4ca1-92fe-69c290cfb036 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:20.708424 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5fc9cd2c-ad6e-4ca1-92fe-69c290cfb036 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:20.708855 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5fc9cd2c-ad6e-4ca1-92fe-69c290cfb036 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:20.844721 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-5fc9cd2c-ad6e-4ca1-92fe-69c290cfb036 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:20.852402 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-5fc9cd2c-ad6e-4ca1-92fe-69c290cfb036 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1" status: 200 len: 1683 microversion: 2.1 time: 0.156550 Jun 07 08:47:20.852962 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 436/879] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:20 2022] GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:21.057160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-b6df46ab-0fd1-40fe-94d2-00520959d61e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:21.057766 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-b6df46ab-0fd1-40fe-94d2-00520959d61e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:21.063876 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b6df46ab-0fd1-40fe-94d2-00520959d61e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:21.064328 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b6df46ab-0fd1-40fe-94d2-00520959d61e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:21.065118 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b6df46ab-0fd1-40fe-94d2-00520959d61e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:21.065548 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b6df46ab-0fd1-40fe-94d2-00520959d61e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:21.195114 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-b6df46ab-0fd1-40fe-94d2-00520959d61e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:21.203277 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-b6df46ab-0fd1-40fe-94d2-00520959d61e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1569 microversion: 2.1 time: 0.150032 Jun 07 08:47:21.203839 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 444/880] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:21 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:21.555658 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-e0976f36-7541-4da2-98f8-700f8dd783b2 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:21.556277 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-e0976f36-7541-4da2-98f8-700f8dd783b2 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: 09a4d297-6aca-4a31-b0c5-25d8fb05af30] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:21.562796 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e0976f36-7541-4da2-98f8-700f8dd783b2 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:21.563242 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e0976f36-7541-4da2-98f8-700f8dd783b2 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:21.563997 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e0976f36-7541-4da2-98f8-700f8dd783b2 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:21.564436 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e0976f36-7541-4da2-98f8-700f8dd783b2 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:21.693910 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-e0976f36-7541-4da2-98f8-700f8dd783b2 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c3d3030c6a4d42a941ae489c5bf125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287c3c3374034e3899d7c8b7d970a738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:21.703434 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-e0976f36-7541-4da2-98f8-700f8dd783b2 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30" status: 200 len: 1319 microversion: 2.1 time: 0.151662 Jun 07 08:47:21.704269 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 437/881] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:21 2022] GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:21.870103 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-061eedce-daa2-4e8a-a338-4202e916f17c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:21.870641 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-061eedce-daa2-4e8a-a338-4202e916f17c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:21.878066 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-061eedce-daa2-4e8a-a338-4202e916f17c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:21.878512 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-061eedce-daa2-4e8a-a338-4202e916f17c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:21.879301 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-061eedce-daa2-4e8a-a338-4202e916f17c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:21.879733 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-061eedce-daa2-4e8a-a338-4202e916f17c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:22.015020 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-061eedce-daa2-4e8a-a338-4202e916f17c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:22.022441 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-061eedce-daa2-4e8a-a338-4202e916f17c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1" status: 200 len: 1683 microversion: 2.1 time: 0.156370 Jun 07 08:47:22.022999 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 445/882] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:21 2022] GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:22.221529 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-b9e131f2-140f-4a98-a3cc-deb6079c4bee tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:22.222148 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-b9e131f2-140f-4a98-a3cc-deb6079c4bee tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:22.228538 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b9e131f2-140f-4a98-a3cc-deb6079c4bee tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:22.228990 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b9e131f2-140f-4a98-a3cc-deb6079c4bee tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:22.231341 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b9e131f2-140f-4a98-a3cc-deb6079c4bee tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:22.231341 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b9e131f2-140f-4a98-a3cc-deb6079c4bee tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:22.371484 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-b9e131f2-140f-4a98-a3cc-deb6079c4bee tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:22.379145 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-b9e131f2-140f-4a98-a3cc-deb6079c4bee tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1569 microversion: 2.1 time: 0.162331 Jun 07 08:47:22.379701 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 438/883] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:22 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:22.720934 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-b9ae3e5e-7cb5-4824-adac-41238381e037 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:22.721603 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-b9ae3e5e-7cb5-4824-adac-41238381e037 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: 09a4d297-6aca-4a31-b0c5-25d8fb05af30] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:22.728369 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b9ae3e5e-7cb5-4824-adac-41238381e037 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:22.728369 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b9ae3e5e-7cb5-4824-adac-41238381e037 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:22.729167 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b9ae3e5e-7cb5-4824-adac-41238381e037 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:22.729614 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b9ae3e5e-7cb5-4824-adac-41238381e037 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:23.039884 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-04b30ba9-c021-4d9b-ba4d-c5bde62de3a6 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:23.040413 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-04b30ba9-c021-4d9b-ba4d-c5bde62de3a6 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:23.047302 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-04b30ba9-c021-4d9b-ba4d-c5bde62de3a6 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:23.047760 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-04b30ba9-c021-4d9b-ba4d-c5bde62de3a6 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:23.048573 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-04b30ba9-c021-4d9b-ba4d-c5bde62de3a6 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:23.049038 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-04b30ba9-c021-4d9b-ba4d-c5bde62de3a6 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:23.059477 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-b9ae3e5e-7cb5-4824-adac-41238381e037 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c3d3030c6a4d42a941ae489c5bf125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287c3c3374034e3899d7c8b7d970a738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:23.068736 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-b9ae3e5e-7cb5-4824-adac-41238381e037 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30" status: 200 len: 1319 microversion: 2.1 time: 0.351861 Jun 07 08:47:23.082417 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 446/884] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:22 2022] GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30 => generated 1319 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:23.183972 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-04b30ba9-c021-4d9b-ba4d-c5bde62de3a6 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:23.192415 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-04b30ba9-c021-4d9b-ba4d-c5bde62de3a6 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1" status: 200 len: 1683 microversion: 2.1 time: 0.156564 Jun 07 08:47:23.193088 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 439/885] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:23 2022] GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:47:23.396689 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-1e251e04-5c3b-44a6-aec9-75408ab0bb31 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:23.397290 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-1e251e04-5c3b-44a6-aec9-75408ab0bb31 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:23.404041 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1e251e04-5c3b-44a6-aec9-75408ab0bb31 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:23.405154 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1e251e04-5c3b-44a6-aec9-75408ab0bb31 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:23.405938 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1e251e04-5c3b-44a6-aec9-75408ab0bb31 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:23.406377 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1e251e04-5c3b-44a6-aec9-75408ab0bb31 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:23.610708 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-1e251e04-5c3b-44a6-aec9-75408ab0bb31 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:23.618354 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-1e251e04-5c3b-44a6-aec9-75408ab0bb31 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1570 microversion: 2.1 time: 0.225942 Jun 07 08:47:23.618908 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 447/886] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:23 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1570 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:23.634649 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-dd4c5a5c-a8ae-47e1-9451-d16cef40ddb6 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:47:23.635218 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-dd4c5a5c-a8ae-47e1-9451-d16cef40ddb6 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:23.642061 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-dd4c5a5c-a8ae-47e1-9451-d16cef40ddb6 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:23.642578 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-dd4c5a5c-a8ae-47e1-9451-d16cef40ddb6 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:23.643322 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-dd4c5a5c-a8ae-47e1-9451-d16cef40ddb6 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:23.643762 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-dd4c5a5c-a8ae-47e1-9451-d16cef40ddb6 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:23.927554 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-dd4c5a5c-a8ae-47e1-9451-d16cef40ddb6 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "POST /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd/action" status: 202 len: 0 microversion: 2.1 time: 0.296677 Jun 07 08:47:23.928474 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 440/887] 10.222.0.17 () {60 vars in 1277 bytes} [Tue Jun 7 08:47:23 2022] POST /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 08:47:23.937331 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-6e49d40d-d794-4768-a8f2-e80eceb4e047 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:23.937950 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-6e49d40d-d794-4768-a8f2-e80eceb4e047 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:23.945407 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6e49d40d-d794-4768-a8f2-e80eceb4e047 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:23.946112 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6e49d40d-d794-4768-a8f2-e80eceb4e047 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:23.947092 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6e49d40d-d794-4768-a8f2-e80eceb4e047 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:23.947703 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6e49d40d-d794-4768-a8f2-e80eceb4e047 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:24.094757 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-1dde8c39-eb93-4950-9123-a42b3aa19280 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:24.095450 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-1dde8c39-eb93-4950-9123-a42b3aa19280 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: 09a4d297-6aca-4a31-b0c5-25d8fb05af30] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:24.102055 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1dde8c39-eb93-4950-9123-a42b3aa19280 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:24.102870 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1dde8c39-eb93-4950-9123-a42b3aa19280 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:24.103825 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1dde8c39-eb93-4950-9123-a42b3aa19280 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:24.104426 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1dde8c39-eb93-4950-9123-a42b3aa19280 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:24.330613 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-6e49d40d-d794-4768-a8f2-e80eceb4e047 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:24.339483 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-1dde8c39-eb93-4950-9123-a42b3aa19280 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c3d3030c6a4d42a941ae489c5bf125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287c3c3374034e3899d7c8b7d970a738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:24.343218 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-6e49d40d-d794-4768-a8f2-e80eceb4e047 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1578 microversion: 2.1 time: 0.409889 Jun 07 08:47:24.344377 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 448/888] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:23 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1578 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:24.349273 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-255fbe41-f96a-458b-a938-cbe973cbfa85 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:24.350129 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-255fbe41-f96a-458b-a938-cbe973cbfa85 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:24.353136 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-1dde8c39-eb93-4950-9123-a42b3aa19280 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30" status: 200 len: 1319 microversion: 2.1 time: 0.266964 Jun 07 08:47:24.357867 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-255fbe41-f96a-458b-a938-cbe973cbfa85 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:24.358558 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-255fbe41-f96a-458b-a938-cbe973cbfa85 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:24.359560 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-255fbe41-f96a-458b-a938-cbe973cbfa85 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:24.360918 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-255fbe41-f96a-458b-a938-cbe973cbfa85 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:24.365240 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 441/889] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:24 2022] GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30 => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:24.455228 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-255fbe41-f96a-458b-a938-cbe973cbfa85 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:24.464060 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-255fbe41-f96a-458b-a938-cbe973cbfa85 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1" status: 200 len: 1615 microversion: 2.1 time: 0.118288 Jun 07 08:47:24.464862 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 449/890] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:24 2022] GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 => generated 1615 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:24.524807 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-53465f4b-6e3c-41e5-bb15-ca3b17931f9a req-e43e88c9-519d-4223-b680-c7f3f0f60952 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1", "name": "network-vif-deleted", "tag": "6b9ee1fc-dcbc-4996-bbdf-3ab4f7e7d28d"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:47:24.535414 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-53465f4b-6e3c-41e5-bb15-ca3b17931f9a req-e43e88c9-519d-4223-b680-c7f3f0f60952 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:24.536110 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-53465f4b-6e3c-41e5-bb15-ca3b17931f9a req-e43e88c9-519d-4223-b680-c7f3f0f60952 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:24.551022 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-53465f4b-6e3c-41e5-bb15-ca3b17931f9a req-e43e88c9-519d-4223-b680-c7f3f0f60952 service nova] Creating event network-vif-deleted:6b9ee1fc-dcbc-4996-bbdf-3ab4f7e7d28d for instance c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 on hv-cinder-74014 Jun 07 08:47:24.556500 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-53465f4b-6e3c-41e5-bb15-ca3b17931f9a req-e43e88c9-519d-4223-b680-c7f3f0f60952 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036425 Jun 07 08:47:24.564170 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 442/891] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:47:25.361062 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-bad1e105-5ec0-4c91-b52c-44666587b418 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:25.362445 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-bad1e105-5ec0-4c91-b52c-44666587b418 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:25.369648 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-bad1e105-5ec0-4c91-b52c-44666587b418 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:25.370181 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-bad1e105-5ec0-4c91-b52c-44666587b418 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:25.370971 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-bad1e105-5ec0-4c91-b52c-44666587b418 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:25.371489 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-bad1e105-5ec0-4c91-b52c-44666587b418 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:25.374152 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-4243db61-aac0-4119-b0a7-121d05a2bf50 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:25.374851 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-4243db61-aac0-4119-b0a7-121d05a2bf50 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: 09a4d297-6aca-4a31-b0c5-25d8fb05af30] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:25.385897 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4243db61-aac0-4119-b0a7-121d05a2bf50 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:25.387007 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4243db61-aac0-4119-b0a7-121d05a2bf50 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:25.387801 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4243db61-aac0-4119-b0a7-121d05a2bf50 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:25.388240 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4243db61-aac0-4119-b0a7-121d05a2bf50 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:25.528782 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-bad1e105-5ec0-4c91-b52c-44666587b418 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:25.538645 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-bad1e105-5ec0-4c91-b52c-44666587b418 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1518 microversion: 2.1 time: 0.181482 Jun 07 08:47:25.539724 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 450/892] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:25 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1518 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:25.543234 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-4243db61-aac0-4119-b0a7-121d05a2bf50 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c3d3030c6a4d42a941ae489c5bf125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287c3c3374034e3899d7c8b7d970a738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:25.545331 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-b8d3c71d-06ef-469d-882c-9edb68663edb tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:25.546549 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-b8d3c71d-06ef-469d-882c-9edb68663edb tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:25.553045 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-4243db61-aac0-4119-b0a7-121d05a2bf50 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30" status: 200 len: 1507 microversion: 2.1 time: 0.184081 Jun 07 08:47:25.554880 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b8d3c71d-06ef-469d-882c-9edb68663edb tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:25.555555 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b8d3c71d-06ef-469d-882c-9edb68663edb tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:25.556653 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b8d3c71d-06ef-469d-882c-9edb68663edb tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:25.557364 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b8d3c71d-06ef-469d-882c-9edb68663edb tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:25.562628 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 443/893] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:25 2022] GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30 => generated 1507 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:47:25.601819 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b8d3c71d-06ef-469d-882c-9edb68663edb tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:25.602428 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b8d3c71d-06ef-469d-882c-9edb68663edb tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:25.603133 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.objects.instance [None req-b8d3c71d-06ef-469d-882c-9edb68663edb tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lazy-loading 'fault' on Instance uuid c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 {{(pid=129725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:47:25.666096 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-b8d3c71d-06ef-469d-882c-9edb68663edb tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:25.674553 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-b8d3c71d-06ef-469d-882c-9edb68663edb tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1" status: 200 len: 1331 microversion: 2.1 time: 0.133249 Jun 07 08:47:25.678252 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 451/894] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:25 2022] GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 => generated 1331 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:26.560120 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-9725b532-8e6b-440a-b4b9-4ce7faa19ceb tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:26.562422 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-9725b532-8e6b-440a-b4b9-4ce7faa19ceb tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:26.572326 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9725b532-8e6b-440a-b4b9-4ce7faa19ceb tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:26.573108 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9725b532-8e6b-440a-b4b9-4ce7faa19ceb tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:26.574379 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9725b532-8e6b-440a-b4b9-4ce7faa19ceb tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:26.575104 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9725b532-8e6b-440a-b4b9-4ce7faa19ceb tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:26.694557 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-e5bc2c6c-309f-40cf-94dd-657c079ae3e0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:26.698929 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-e5bc2c6c-309f-40cf-94dd-657c079ae3e0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:26.702492 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e5bc2c6c-309f-40cf-94dd-657c079ae3e0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:26.702951 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e5bc2c6c-309f-40cf-94dd-657c079ae3e0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:26.703731 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e5bc2c6c-309f-40cf-94dd-657c079ae3e0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:26.704171 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e5bc2c6c-309f-40cf-94dd-657c079ae3e0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:26.726225 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-9725b532-8e6b-440a-b4b9-4ce7faa19ceb tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:26.735447 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.wsgi [None req-e5bc2c6c-309f-40cf-94dd-657c079ae3e0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] HTTP exception thrown: Instance c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 could not be found. Jun 07 08:47:26.736141 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-9725b532-8e6b-440a-b4b9-4ce7faa19ceb tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1520 microversion: 2.1 time: 0.182307 Jun 07 08:47:26.746443 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 444/895] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:26 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:26.746677 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-e5bc2c6c-309f-40cf-94dd-657c079ae3e0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Request method failure captured: Jun 07 08:47:26.746677 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: request: GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 HTTP/1.1 Jun 07 08:47:26.746677 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept: application/json Jun 07 08:47:26.746677 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept-Encoding: identity Jun 07 08:47:26.746677 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Connection: close Jun 07 08:47:26.746677 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Length: 0 Jun 07 08:47:26.746677 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Type: application/json Jun 07 08:47:26.746677 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Host: 10.222.0.17 Jun 07 08:47:26.746677 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Openstack-System-Scope: None Jun 07 08:47:26.746677 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: User-Agent: python-urllib3/1.26.9 Jun 07 08:47:26.746677 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Auth-Token: gAAAAABinxAgj5C7ouE1N-aaB4GYPlt92HgnY7l_4qNjeb7MhcXewkqTDq3SwhJjBOupqPwAwi-EUO3Doxu5eOmMdEwFCWQlkuqeuPwgDsRWAIP7QSDJjzl4qrePMCoCSyDT0Sg0QJjM04PVEJfbaffcjJA3z-4CjpQwrMDzvrui6SNaABiQiRQ Jun 07 08:47:26.746677 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Id: None Jun 07 08:47:26.746677 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Name: None Jun 07 08:47:26.746677 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Identity-Status: Confirmed Jun 07 08:47:26.746677 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Is-Admin-Project: True Jun 07 08:47:26.746677 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Id: default Jun 07 08:47:26.746677 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Name: Default Jun 07 08:47:26.746677 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Id: 0899cad1b7c64a0199b3466d4c7cfefb Jun 07 08:47:26.746677 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Name: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:47:26.746677 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Role: reader,member Jun 07 08:47:26.746677 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Roles: reader,member Jun 07 08:47:26.749141 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0899cad1b7c64a0199b3466d4c7cfefb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0899cad1b7c64a0199b3466d4c7cfefb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0899cad1b7c64a0199b3466d4c7cfefb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0899cad1b7c64a0199b3466d4c7cfefb"}]}] Jun 07 08:47:26.749141 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:47:26.749141 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Id: 0899cad1b7c64a0199b3466d4c7cfefb Jun 07 08:47:26.749141 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:47:26.749141 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User: tempest-AttachVolumeNegativeTest-1278776647-project Jun 07 08:47:26.749141 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Id: default Jun 07 08:47:26.749141 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Name: Default Jun 07 08:47:26.749141 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Id: 52ddf59fe764404eb1c6ee745e21d352 Jun 07 08:47:26.749141 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Name: tempest-AttachVolumeNegativeTest-1278776647-project Jun 07 08:47:26.749141 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: method: > Jun 07 08:47:26.749141 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: exception: Instance c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 could not be found. Jun 07 08:47:26.749141 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: action_args: {'id': 'c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1'} Jun 07 08:47:26.750105 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:47:26.750105 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:47:26.750105 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:47:26.750105 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:47:26.750105 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:47:26.750105 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:47:26.750105 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:47:26.750105 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:47:26.750105 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:47:26.750105 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:47:26.750105 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 could not be found. Jun 07 08:47:26.750105 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:47:26.750105 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:47:26.750105 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:47:26.750105 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:47:26.750105 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:47:26.750105 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:47:26.750105 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:47:26.750105 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:47:26.750105 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:47:26.751671 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:47:26.751671 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 08:47:26.751671 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 08:47:26.751671 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:47:26.751671 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:47:26.751671 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:47:26.751671 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:47:26.751671 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 could not be found. Jun 07 08:47:26.751671 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:47:26.751671 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:47:26.751671 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:47:26.751671 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:47:26.751671 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:47:26.751671 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:47:26.751671 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:47:26.751671 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:47:26.751671 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 could not be found. Jun 07 08:47:26.751671 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:47:26.753231 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-e5bc2c6c-309f-40cf-94dd-657c079ae3e0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Returning 404 to user: Instance c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 could not be found. {{(pid=129725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:47:26.753231 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-e5bc2c6c-309f-40cf-94dd-657c079ae3e0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1" status: 404 len: 111 microversion: 2.1 time: 0.050126 Jun 07 08:47:26.753231 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 452/896] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:26 2022] GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 08:47:26.753497 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-e359f705-033b-4f61-b88c-b020033e4a38 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '.version_select at 0x7f7fecc36ca0>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:26.880504 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-e359f705-033b-4f61-b88c-b020033e4a38 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1090236951" status: 202 len: 0 microversion: 2.1 time: 0.136731 Jun 07 08:47:26.881366 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 445/897] 10.222.0.17 () {58 vars in 1220 bytes} [Tue Jun 7 08:47:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1090236951 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 08:47:27.754132 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-83904831-a82b-47c8-b2cb-49746c4cedf6 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:27.754822 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-83904831-a82b-47c8-b2cb-49746c4cedf6 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:27.761381 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-83904831-a82b-47c8-b2cb-49746c4cedf6 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:27.761838 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-83904831-a82b-47c8-b2cb-49746c4cedf6 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:27.762617 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-83904831-a82b-47c8-b2cb-49746c4cedf6 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:27.763056 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-83904831-a82b-47c8-b2cb-49746c4cedf6 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:27.856100 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-5434d8ec-fea8-4ea1-90c6-4d334ce35cb3 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:27.856714 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-5434d8ec-fea8-4ea1-90c6-4d334ce35cb3 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:27.863242 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5434d8ec-fea8-4ea1-90c6-4d334ce35cb3 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:27.863686 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5434d8ec-fea8-4ea1-90c6-4d334ce35cb3 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:27.864528 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5434d8ec-fea8-4ea1-90c6-4d334ce35cb3 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:27.865087 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5434d8ec-fea8-4ea1-90c6-4d334ce35cb3 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:27.959597 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.objects.instance [None req-5434d8ec-fea8-4ea1-90c6-4d334ce35cb3 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lazy-loading 'services' on Instance uuid a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 {{(pid=129726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:47:27.985953 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-83904831-a82b-47c8-b2cb-49746c4cedf6 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:27.993633 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-83904831-a82b-47c8-b2cb-49746c4cedf6 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1576 microversion: 2.1 time: 0.243370 Jun 07 08:47:27.994200 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 453/898] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:27 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1576 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:28.188281 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-5434d8ec-fea8-4ea1-90c6-4d334ce35cb3 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22/os-volume_attachments/135f77aa-86da-40c6-83e4-7c85c0bd6e9c" status: 202 len: 0 microversion: 2.1 time: 0.339152 Jun 07 08:47:28.188894 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 446/899] 10.222.0.17 () {58 vars in 1415 bytes} [Tue Jun 7 08:47:27 2022] DELETE /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22/os-volume_attachments/135f77aa-86da-40c6-83e4-7c85c0bd6e9c => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 08:47:28.197297 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-3c9a3705-2af0-43e2-8fad-6dab20ec9aed tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:28.198719 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-3c9a3705-2af0-43e2-8fad-6dab20ec9aed tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:28.205770 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3c9a3705-2af0-43e2-8fad-6dab20ec9aed tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:28.206696 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3c9a3705-2af0-43e2-8fad-6dab20ec9aed tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:28.208017 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3c9a3705-2af0-43e2-8fad-6dab20ec9aed tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:28.208623 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3c9a3705-2af0-43e2-8fad-6dab20ec9aed tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:28.255006 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-3c9a3705-2af0-43e2-8fad-6dab20ec9aed tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061656 Jun 07 08:47:28.255587 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 454/900] 10.222.0.17 () {58 vars in 1301 bytes} [Tue Jun 7 08:47:28 2022] GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:47:29.011477 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-574be91c-f825-4185-86f1-aafafa8c86ce tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:29.012282 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-574be91c-f825-4185-86f1-aafafa8c86ce tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:29.019309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-574be91c-f825-4185-86f1-aafafa8c86ce tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:29.019754 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-574be91c-f825-4185-86f1-aafafa8c86ce tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:29.020514 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-574be91c-f825-4185-86f1-aafafa8c86ce tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:29.020950 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-574be91c-f825-4185-86f1-aafafa8c86ce tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:29.157259 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-574be91c-f825-4185-86f1-aafafa8c86ce tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:29.165125 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-574be91c-f825-4185-86f1-aafafa8c86ce tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1576 microversion: 2.1 time: 0.157894 Jun 07 08:47:29.165690 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 447/901] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:29 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:29.266553 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-8b17d47d-ca2b-4684-89f8-9d2f469da2ee tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:29.267448 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-8b17d47d-ca2b-4684-89f8-9d2f469da2ee tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:29.274089 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8b17d47d-ca2b-4684-89f8-9d2f469da2ee tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:29.274547 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8b17d47d-ca2b-4684-89f8-9d2f469da2ee tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:29.275404 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8b17d47d-ca2b-4684-89f8-9d2f469da2ee tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:29.275844 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8b17d47d-ca2b-4684-89f8-9d2f469da2ee tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:29.307467 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-8b17d47d-ca2b-4684-89f8-9d2f469da2ee tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045525 Jun 07 08:47:29.308024 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 455/902] 10.222.0.17 () {58 vars in 1301 bytes} [Tue Jun 7 08:47:29 2022] GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:47:30.184373 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-4fa18ae9-3f59-4f8c-a578-0a300a5239c5 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:30.185012 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-4fa18ae9-3f59-4f8c-a578-0a300a5239c5 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:30.192093 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4fa18ae9-3f59-4f8c-a578-0a300a5239c5 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:30.192538 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4fa18ae9-3f59-4f8c-a578-0a300a5239c5 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:30.193374 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4fa18ae9-3f59-4f8c-a578-0a300a5239c5 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:30.193783 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4fa18ae9-3f59-4f8c-a578-0a300a5239c5 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:30.320102 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-f8e5570e-2601-45e9-b895-c572c10c7058 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:30.322385 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-f8e5570e-2601-45e9-b895-c572c10c7058 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:30.329337 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f8e5570e-2601-45e9-b895-c572c10c7058 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:30.329780 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f8e5570e-2601-45e9-b895-c572c10c7058 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:30.330561 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f8e5570e-2601-45e9-b895-c572c10c7058 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:30.330994 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f8e5570e-2601-45e9-b895-c572c10c7058 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:30.332544 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-4fa18ae9-3f59-4f8c-a578-0a300a5239c5 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:30.340027 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-4fa18ae9-3f59-4f8c-a578-0a300a5239c5 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1576 microversion: 2.1 time: 0.159518 Jun 07 08:47:30.345051 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 448/903] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:30 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:30.364345 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-f8e5570e-2601-45e9-b895-c572c10c7058 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048440 Jun 07 08:47:30.364919 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 456/904] 10.222.0.17 () {58 vars in 1301 bytes} [Tue Jun 7 08:47:30 2022] GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 07 08:47:30.424894 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-6bfa1d9b-8c6c-4d47-827c-040b34bcd819 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:30.425451 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-6bfa1d9b-8c6c-4d47-827c-040b34bcd819 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:30.431388 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6bfa1d9b-8c6c-4d47-827c-040b34bcd819 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:30.431840 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6bfa1d9b-8c6c-4d47-827c-040b34bcd819 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:30.432599 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6bfa1d9b-8c6c-4d47-827c-040b34bcd819 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:30.433055 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6bfa1d9b-8c6c-4d47-827c-040b34bcd819 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:30.460591 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-6bfa1d9b-8c6c-4d47-827c-040b34bcd819 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22] Going to try to terminate instance {{(pid=129726) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 08:47:30.611618 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:47:30.777910 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-6bfa1d9b-8c6c-4d47-827c-040b34bcd819 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22" status: 204 len: 0 microversion: 2.1 time: 0.356458 Jun 07 08:47:30.778468 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 449/905] 10.222.0.17 () {58 vars in 1238 bytes} [Tue Jun 7 08:47:30 2022] DELETE /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 08:47:30.787156 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-48b520c1-992f-4ddf-8f18-ed658915f322 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:30.787789 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-48b520c1-992f-4ddf-8f18-ed658915f322 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:30.794091 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-48b520c1-992f-4ddf-8f18-ed658915f322 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:30.795357 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-48b520c1-992f-4ddf-8f18-ed658915f322 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:30.796265 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-48b520c1-992f-4ddf-8f18-ed658915f322 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:30.796737 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-48b520c1-992f-4ddf-8f18-ed658915f322 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:30.936629 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-48b520c1-992f-4ddf-8f18-ed658915f322 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:30.944899 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-48b520c1-992f-4ddf-8f18-ed658915f322 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22" status: 200 len: 1681 microversion: 2.1 time: 0.161449 Jun 07 08:47:30.945517 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 457/906] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:30 2022] GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:31.359578 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-94f7cafd-c45c-4769-a44d-9b05e0bf5fb3 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:31.360286 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-94f7cafd-c45c-4769-a44d-9b05e0bf5fb3 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:31.367345 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-94f7cafd-c45c-4769-a44d-9b05e0bf5fb3 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:31.367790 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-94f7cafd-c45c-4769-a44d-9b05e0bf5fb3 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:31.368554 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-94f7cafd-c45c-4769-a44d-9b05e0bf5fb3 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:31.368984 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-94f7cafd-c45c-4769-a44d-9b05e0bf5fb3 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:31.510298 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-94f7cafd-c45c-4769-a44d-9b05e0bf5fb3 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:31.517848 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-94f7cafd-c45c-4769-a44d-9b05e0bf5fb3 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1576 microversion: 2.1 time: 0.163996 Jun 07 08:47:31.518410 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 450/907] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:31 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:31.962677 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-09eb1cce-e85e-4fb4-912d-e9efb4ff3386 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:31.963286 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-09eb1cce-e85e-4fb4-912d-e9efb4ff3386 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:31.970350 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-09eb1cce-e85e-4fb4-912d-e9efb4ff3386 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:31.970799 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-09eb1cce-e85e-4fb4-912d-e9efb4ff3386 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:31.971554 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-09eb1cce-e85e-4fb4-912d-e9efb4ff3386 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:31.971989 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-09eb1cce-e85e-4fb4-912d-e9efb4ff3386 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:32.102478 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-09eb1cce-e85e-4fb4-912d-e9efb4ff3386 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:32.105926 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=100 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:47:32.111127 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-09eb1cce-e85e-4fb4-912d-e9efb4ff3386 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22" status: 200 len: 1681 microversion: 2.1 time: 0.152295 Jun 07 08:47:32.111752 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 458/908] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:31 2022] GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:32.535822 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-3f2e71a8-267b-4b32-8f3b-669223f9fbc0 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:32.536377 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-3f2e71a8-267b-4b32-8f3b-669223f9fbc0 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:32.543449 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3f2e71a8-267b-4b32-8f3b-669223f9fbc0 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:32.543896 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3f2e71a8-267b-4b32-8f3b-669223f9fbc0 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:32.544650 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3f2e71a8-267b-4b32-8f3b-669223f9fbc0 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:32.545125 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3f2e71a8-267b-4b32-8f3b-669223f9fbc0 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:32.683814 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-3f2e71a8-267b-4b32-8f3b-669223f9fbc0 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:32.692417 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-3f2e71a8-267b-4b32-8f3b-669223f9fbc0 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1576 microversion: 2.1 time: 0.160437 Jun 07 08:47:32.693022 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 451/909] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:32 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:33.128427 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-820e8aba-4c6e-487f-8dba-97583e666458 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:33.129468 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-820e8aba-4c6e-487f-8dba-97583e666458 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:33.136712 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-820e8aba-4c6e-487f-8dba-97583e666458 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:33.137204 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-820e8aba-4c6e-487f-8dba-97583e666458 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:33.138012 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-820e8aba-4c6e-487f-8dba-97583e666458 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:33.138447 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-820e8aba-4c6e-487f-8dba-97583e666458 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:33.334588 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-820e8aba-4c6e-487f-8dba-97583e666458 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:33.342305 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-820e8aba-4c6e-487f-8dba-97583e666458 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22" status: 200 len: 1681 microversion: 2.1 time: 0.218349 Jun 07 08:47:33.343685 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 459/910] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:33 2022] GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 => generated 1681 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:33.709806 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-5e4cd85b-d6c2-4dae-b3cf-bc0e8cbca9b6 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:33.710675 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-5e4cd85b-d6c2-4dae-b3cf-bc0e8cbca9b6 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:33.714251 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:47:33.718773 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-b1a44c30-5637-4ce6-985f-23dc374664cb req-55cfd523-a4d1-4ccb-a219-6b83d852ce3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22", "name": "network-vif-deleted", "tag": "cb4a5e6c-f7ac-4c67-a28c-5b44fe5f7fdb"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:47:33.727359 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5e4cd85b-d6c2-4dae-b3cf-bc0e8cbca9b6 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:33.727359 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5e4cd85b-d6c2-4dae-b3cf-bc0e8cbca9b6 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:33.727359 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5e4cd85b-d6c2-4dae-b3cf-bc0e8cbca9b6 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:33.727359 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5e4cd85b-d6c2-4dae-b3cf-bc0e8cbca9b6 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:33.727858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-b1a44c30-5637-4ce6-985f-23dc374664cb req-55cfd523-a4d1-4ccb-a219-6b83d852ce3b service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:33.728232 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-b1a44c30-5637-4ce6-985f-23dc374664cb req-55cfd523-a4d1-4ccb-a219-6b83d852ce3b service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:33.742969 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-b1a44c30-5637-4ce6-985f-23dc374664cb req-55cfd523-a4d1-4ccb-a219-6b83d852ce3b service nova] Creating event network-vif-deleted:cb4a5e6c-f7ac-4c67-a28c-5b44fe5f7fdb for instance a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 on hv-cinder-74014 Jun 07 08:47:33.748251 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-b1a44c30-5637-4ce6-985f-23dc374664cb req-55cfd523-a4d1-4ccb-a219-6b83d852ce3b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033271 Jun 07 08:47:33.748882 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 460/911] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:47:33.893675 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-5e4cd85b-d6c2-4dae-b3cf-bc0e8cbca9b6 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:33.901937 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-5e4cd85b-d6c2-4dae-b3cf-bc0e8cbca9b6 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1576 microversion: 2.1 time: 0.195809 Jun 07 08:47:33.902960 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 452/912] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:33 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1576 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:34.362249 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-6da3605e-1d63-45e4-85e7-1756c8a30da0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:34.363767 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-6da3605e-1d63-45e4-85e7-1756c8a30da0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:34.370363 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6da3605e-1d63-45e4-85e7-1756c8a30da0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:34.370821 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6da3605e-1d63-45e4-85e7-1756c8a30da0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:34.371830 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6da3605e-1d63-45e4-85e7-1756c8a30da0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:34.372403 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6da3605e-1d63-45e4-85e7-1756c8a30da0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:34.408491 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6da3605e-1d63-45e4-85e7-1756c8a30da0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:34.409086 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6da3605e-1d63-45e4-85e7-1756c8a30da0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:34.409630 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.objects.instance [None req-6da3605e-1d63-45e4-85e7-1756c8a30da0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lazy-loading 'fault' on Instance uuid a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 {{(pid=129725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:47:34.455593 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-6da3605e-1d63-45e4-85e7-1756c8a30da0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:34.464609 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-6da3605e-1d63-45e4-85e7-1756c8a30da0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22" status: 200 len: 1331 microversion: 2.1 time: 0.107855 Jun 07 08:47:34.465456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 461/913] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:34 2022] GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 => generated 1331 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:34.919849 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-c5578551-5d0b-48c6-af83-103aa9c0a437 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:34.920551 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-c5578551-5d0b-48c6-af83-103aa9c0a437 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:34.928039 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c5578551-5d0b-48c6-af83-103aa9c0a437 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:34.928489 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c5578551-5d0b-48c6-af83-103aa9c0a437 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:34.929284 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c5578551-5d0b-48c6-af83-103aa9c0a437 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:34.929722 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c5578551-5d0b-48c6-af83-103aa9c0a437 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:35.076739 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-c5578551-5d0b-48c6-af83-103aa9c0a437 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:35.084983 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-c5578551-5d0b-48c6-af83-103aa9c0a437 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1576 microversion: 2.1 time: 0.169128 Jun 07 08:47:35.085619 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 453/914] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:34 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:35.482217 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-84498533-65ab-4bf1-8df2-10861915674b tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:35.482812 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-84498533-65ab-4bf1-8df2-10861915674b tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:35.486323 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:47:35.489795 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-84498533-65ab-4bf1-8df2-10861915674b tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:35.490240 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-84498533-65ab-4bf1-8df2-10861915674b tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:35.490998 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-84498533-65ab-4bf1-8df2-10861915674b tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:35.491443 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-84498533-65ab-4bf1-8df2-10861915674b tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:35.506451 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.wsgi [None req-84498533-65ab-4bf1-8df2-10861915674b tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] HTTP exception thrown: Instance a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 could not be found. Jun 07 08:47:35.509860 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-84498533-65ab-4bf1-8df2-10861915674b tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Request method failure captured: Jun 07 08:47:35.509860 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: request: GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 HTTP/1.1 Jun 07 08:47:35.509860 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept: application/json Jun 07 08:47:35.509860 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept-Encoding: identity Jun 07 08:47:35.509860 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Connection: close Jun 07 08:47:35.509860 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Length: 0 Jun 07 08:47:35.509860 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Type: application/json Jun 07 08:47:35.509860 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Host: 10.222.0.17 Jun 07 08:47:35.509860 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Openstack-System-Scope: None Jun 07 08:47:35.509860 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: User-Agent: python-urllib3/1.26.9 Jun 07 08:47:35.509860 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Auth-Token: gAAAAABinxAgj5C7ouE1N-aaB4GYPlt92HgnY7l_4qNjeb7MhcXewkqTDq3SwhJjBOupqPwAwi-EUO3Doxu5eOmMdEwFCWQlkuqeuPwgDsRWAIP7QSDJjzl4qrePMCoCSyDT0Sg0QJjM04PVEJfbaffcjJA3z-4CjpQwrMDzvrui6SNaABiQiRQ Jun 07 08:47:35.509860 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Id: None Jun 07 08:47:35.509860 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Name: None Jun 07 08:47:35.509860 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Identity-Status: Confirmed Jun 07 08:47:35.509860 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Is-Admin-Project: True Jun 07 08:47:35.509860 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Id: default Jun 07 08:47:35.509860 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Name: Default Jun 07 08:47:35.509860 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Id: 0899cad1b7c64a0199b3466d4c7cfefb Jun 07 08:47:35.509860 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Name: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:47:35.509860 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Role: reader,member Jun 07 08:47:35.509860 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Roles: reader,member Jun 07 08:47:35.511560 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0899cad1b7c64a0199b3466d4c7cfefb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0899cad1b7c64a0199b3466d4c7cfefb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0899cad1b7c64a0199b3466d4c7cfefb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0899cad1b7c64a0199b3466d4c7cfefb"}]}] Jun 07 08:47:35.511560 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:47:35.511560 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Id: 0899cad1b7c64a0199b3466d4c7cfefb Jun 07 08:47:35.511560 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:47:35.511560 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User: tempest-AttachVolumeNegativeTest-1278776647-project Jun 07 08:47:35.511560 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Id: default Jun 07 08:47:35.511560 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Name: Default Jun 07 08:47:35.511560 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Id: 52ddf59fe764404eb1c6ee745e21d352 Jun 07 08:47:35.511560 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Name: tempest-AttachVolumeNegativeTest-1278776647-project Jun 07 08:47:35.511560 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: method: > Jun 07 08:47:35.511560 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: exception: Instance a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 could not be found. Jun 07 08:47:35.511560 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: action_args: {'id': 'a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22'} Jun 07 08:47:35.512501 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:47:35.512501 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:47:35.512501 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:47:35.512501 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:47:35.512501 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:47:35.512501 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:47:35.512501 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:47:35.512501 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:47:35.512501 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:47:35.512501 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:47:35.512501 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 could not be found. Jun 07 08:47:35.512501 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:47:35.512501 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:47:35.512501 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:47:35.512501 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:47:35.512501 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:47:35.512501 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:47:35.512501 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:47:35.512501 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:47:35.512501 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:47:35.514174 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:47:35.514174 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 08:47:35.514174 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 08:47:35.514174 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:47:35.514174 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:47:35.514174 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:47:35.514174 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:47:35.514174 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 could not be found. Jun 07 08:47:35.514174 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:47:35.514174 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:47:35.514174 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:47:35.514174 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:47:35.514174 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:47:35.514174 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:47:35.514174 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:47:35.514174 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:47:35.514174 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 could not be found. Jun 07 08:47:35.514174 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:47:35.516079 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-84498533-65ab-4bf1-8df2-10861915674b tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Returning 404 to user: Instance a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 could not be found. {{(pid=129725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:47:35.516079 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-84498533-65ab-4bf1-8df2-10861915674b tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22" status: 404 len: 111 microversion: 2.1 time: 0.031215 Jun 07 08:47:35.516079 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 462/915] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:35 2022] GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:47:35.519861 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-261693d4-9044-4818-9e5d-7ab2babbd1dd tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '.version_select at 0x7f7fecbea9d0>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:35.645692 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-261693d4-9044-4818-9e5d-7ab2babbd1dd tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-474949863" status: 202 len: 0 microversion: 2.1 time: 0.129859 Jun 07 08:47:35.646295 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 454/916] 10.222.0.17 () {58 vars in 1217 bytes} [Tue Jun 7 08:47:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-474949863 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 08:47:36.104091 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-d1e29b38-1bdc-4dc6-b170-28072f3a54a1 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:36.104698 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-d1e29b38-1bdc-4dc6-b170-28072f3a54a1 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:36.112738 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d1e29b38-1bdc-4dc6-b170-28072f3a54a1 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:36.113224 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d1e29b38-1bdc-4dc6-b170-28072f3a54a1 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:36.114013 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d1e29b38-1bdc-4dc6-b170-28072f3a54a1 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:36.114449 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d1e29b38-1bdc-4dc6-b170-28072f3a54a1 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:36.265860 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-d1e29b38-1bdc-4dc6-b170-28072f3a54a1 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:36.274196 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-d1e29b38-1bdc-4dc6-b170-28072f3a54a1 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1576 microversion: 2.1 time: 0.173852 Jun 07 08:47:36.274873 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 463/917] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:36 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:36.486964 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-932978be-3c70-431f-9540-7dbf4ad6effe tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Action: 'create', calling method: .version_select at 0x7f7fecb24790>, body: {"keypair": {"name": "tempest-keypair-645177096", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhTXUH/QgP7O25bsOP9kHmRHf6XNsdEkuSst3TdDmj0e9A444C/0Ye2IHJn2yl79dhv3KLtb1poEFuEnBwAcPeXWNkb9cvb5yj8yv5n8EVz9AGs4fzd/vK3mXXg0izu8A=="}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:47:36.502186 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-932978be-3c70-431f-9540-7dbf4ad6effe tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Getting quotas for project 0899cad1b7c64a0199b3466d4c7cfefb. Resources: {'key_pairs'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 08:47:36.506308 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-932978be-3c70-431f-9540-7dbf4ad6effe tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Getting quotas for user 52ddf59fe764404eb1c6ee745e21d352 and project 0899cad1b7c64a0199b3466d4c7cfefb. Resources: {'key_pairs'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 08:47:36.566503 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-932978be-3c70-431f-9540-7dbf4ad6effe tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.083852 Jun 07 08:47:36.567186 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 455/918] 10.222.0.17 () {60 vars in 1158 bytes} [Tue Jun 7 08:47:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:47:37.291964 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-b9c1fe55-fa8c-4c90-9dec-752ec04d1c4d tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:37.292542 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-b9c1fe55-fa8c-4c90-9dec-752ec04d1c4d tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:37.299364 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b9c1fe55-fa8c-4c90-9dec-752ec04d1c4d tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:37.299803 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b9c1fe55-fa8c-4c90-9dec-752ec04d1c4d tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:37.300561 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b9c1fe55-fa8c-4c90-9dec-752ec04d1c4d tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:37.301012 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b9c1fe55-fa8c-4c90-9dec-752ec04d1c4d tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:37.439483 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-b9c1fe55-fa8c-4c90-9dec-752ec04d1c4d tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:37.447681 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-b9c1fe55-fa8c-4c90-9dec-752ec04d1c4d tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1576 microversion: 2.1 time: 0.159773 Jun 07 08:47:37.448211 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 464/919] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:37 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:38.363745 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-9e98d9bf-a609-45c3-ad47-2b695a04a0f0 req-32d72ba3-de5f-4911-b1eb-ffa496dff465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb70e18b-43bf-402d-9d70-028908bfc7fd", "name": "network-vif-plugged", "status": "completed", "tag": "c5b234fe-05ce-4bf2-a2ef-1e4c55770be9"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:47:38.373285 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-9e98d9bf-a609-45c3-ad47-2b695a04a0f0 req-32d72ba3-de5f-4911-b1eb-ffa496dff465 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:38.373783 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-9e98d9bf-a609-45c3-ad47-2b695a04a0f0 req-32d72ba3-de5f-4911-b1eb-ffa496dff465 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:38.385782 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-9e98d9bf-a609-45c3-ad47-2b695a04a0f0 req-32d72ba3-de5f-4911-b1eb-ffa496dff465 service nova] Creating event network-vif-plugged:c5b234fe-05ce-4bf2-a2ef-1e4c55770be9 for instance cb70e18b-43bf-402d-9d70-028908bfc7fd on hv-cinder-74014 Jun 07 08:47:38.391040 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-9e98d9bf-a609-45c3-ad47-2b695a04a0f0 req-32d72ba3-de5f-4911-b1eb-ffa496dff465 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030954 Jun 07 08:47:38.391845 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 456/920] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:47:38.465458 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-5191e441-f2c3-402a-aa92-08c7006e94b4 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:38.466296 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-5191e441-f2c3-402a-aa92-08c7006e94b4 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:38.472986 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5191e441-f2c3-402a-aa92-08c7006e94b4 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:38.473553 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5191e441-f2c3-402a-aa92-08c7006e94b4 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:38.474327 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5191e441-f2c3-402a-aa92-08c7006e94b4 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:38.474770 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5191e441-f2c3-402a-aa92-08c7006e94b4 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:38.589997 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-e082cb16-ffdc-4076-86e0-81bd42701129 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1457004783", "imageRef": "c04b0a92-7675-47c3-bcc2-8a2a59b997c3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "887f6fc8-6e65-421d-990a-570b64e04d42"}], "security_groups": [{"name": "tempest-securitygroup--1133567570"}], "key_name": "tempest-keypair-645177096", "user_data": "}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:47:38.612699 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-5191e441-f2c3-402a-aa92-08c7006e94b4 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:38.620785 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-5191e441-f2c3-402a-aa92-08c7006e94b4 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1576 microversion: 2.1 time: 0.159162 Jun 07 08:47:38.621477 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 465/921] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:38 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:38.698871 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.network.neutron [None req-e082cb16-ffdc-4076-86e0-81bd42701129 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] validate_networks() for [('887f6fc8-6e65-421d-990a-570b64e04d42', None, None, None, None, None)] {{(pid=129726) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 08:47:39.065943 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-e082cb16-ffdc-4076-86e0-81bd42701129 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Flavor limits 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 08:47:39.066364 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-e082cb16-ffdc-4076-86e0-81bd42701129 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Image limits 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 08:47:39.066842 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-e082cb16-ffdc-4076-86e0-81bd42701129 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Flavor pref 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 08:47:39.067245 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-e082cb16-ffdc-4076-86e0-81bd42701129 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Image pref 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 08:47:39.067653 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-e082cb16-ffdc-4076-86e0-81bd42701129 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 08:47:39.076345 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e082cb16-ffdc-4076-86e0-81bd42701129 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:39.076786 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e082cb16-ffdc-4076-86e0-81bd42701129 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:39.078123 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e082cb16-ffdc-4076-86e0-81bd42701129 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:39.078553 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e082cb16-ffdc-4076-86e0-81bd42701129 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:39.095005 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-e082cb16-ffdc-4076-86e0-81bd42701129 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Getting quotas for project 0899cad1b7c64a0199b3466d4c7cfefb. Resources: {'ram', 'cores', 'instances'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 08:47:39.098795 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-e082cb16-ffdc-4076-86e0-81bd42701129 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Getting quotas for user 52ddf59fe764404eb1c6ee745e21d352 and project 0899cad1b7c64a0199b3466d4c7cfefb. Resources: {'ram', 'cores', 'instances'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 08:47:39.109242 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-e082cb16-ffdc-4076-86e0-81bd42701129 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Going to run 1 instances... {{(pid=129726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 08:47:39.111522 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-e082cb16-ffdc-4076-86e0-81bd42701129 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: 08308b76-0df7-4c43-a434-6880034a8c54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c04b0a92-7675-47c3-bcc2-8a2a59b997c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 08:47:39.230307 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-e082cb16-ffdc-4076-86e0-81bd42701129 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.645723 Jun 07 08:47:39.230953 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 457/922] 10.222.0.17 () {60 vars in 1146 bytes} [Tue Jun 7 08:47:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 07 08:47:39.240770 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-0daf9660-60b7-4269-986a-e04da108757c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:39.241420 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-0daf9660-60b7-4269-986a-e04da108757c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: 08308b76-0df7-4c43-a434-6880034a8c54] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:39.296389 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-0daf9660-60b7-4269-986a-e04da108757c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:39.302937 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-0daf9660-60b7-4269-986a-e04da108757c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54" status: 200 len: 1241 microversion: 2.1 time: 0.065968 Jun 07 08:47:39.303499 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 466/923] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:39 2022] GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:39.638248 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-827432de-0114-4447-86a1-936587c26c5e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:39.638900 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-827432de-0114-4447-86a1-936587c26c5e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:39.645623 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-827432de-0114-4447-86a1-936587c26c5e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:39.646219 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-827432de-0114-4447-86a1-936587c26c5e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:39.646993 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-827432de-0114-4447-86a1-936587c26c5e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:39.647431 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-827432de-0114-4447-86a1-936587c26c5e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:39.780747 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-827432de-0114-4447-86a1-936587c26c5e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:39.788392 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-827432de-0114-4447-86a1-936587c26c5e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1576 microversion: 2.1 time: 0.154546 Jun 07 08:47:39.792160 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 458/924] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:39 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:40.319687 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-a71a64a3-bede-4be5-98e0-862797d445e7 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:40.320226 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-a71a64a3-bede-4be5-98e0-862797d445e7 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: 08308b76-0df7-4c43-a434-6880034a8c54] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:40.327796 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a71a64a3-bede-4be5-98e0-862797d445e7 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:40.333137 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a71a64a3-bede-4be5-98e0-862797d445e7 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:40.333137 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a71a64a3-bede-4be5-98e0-862797d445e7 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:40.333137 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a71a64a3-bede-4be5-98e0-862797d445e7 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:40.388885 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-a71a64a3-bede-4be5-98e0-862797d445e7 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:40.397493 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-a71a64a3-bede-4be5-98e0-862797d445e7 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54" status: 200 len: 1245 microversion: 2.1 time: 0.081630 Jun 07 08:47:40.398362 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 467/925] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:40 2022] GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:47:40.805900 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-d87cc460-0e10-4403-af98-cbc6ecbee005 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:40.806519 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-d87cc460-0e10-4403-af98-cbc6ecbee005 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:40.813029 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d87cc460-0e10-4403-af98-cbc6ecbee005 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:40.813509 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d87cc460-0e10-4403-af98-cbc6ecbee005 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:40.814267 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d87cc460-0e10-4403-af98-cbc6ecbee005 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:40.814703 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d87cc460-0e10-4403-af98-cbc6ecbee005 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:40.949308 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-d87cc460-0e10-4403-af98-cbc6ecbee005 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:40.957482 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-d87cc460-0e10-4403-af98-cbc6ecbee005 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1563 microversion: 2.1 time: 0.155358 Jun 07 08:47:40.958052 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 459/926] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:40 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:41.088022 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-473b5e60-ea32-4708-a57b-dfa7a81660fc tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96d590da-65bd-40e7-b8ea-262ea7f0aa90", "device": "/dev/sdb"}} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:47:41.089613 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-473b5e60-ea32-4708-a57b-dfa7a81660fc tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: 09a4d297-6aca-4a31-b0c5-25d8fb05af30] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:41.096139 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-473b5e60-ea32-4708-a57b-dfa7a81660fc tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:41.096653 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-473b5e60-ea32-4708-a57b-dfa7a81660fc tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:41.097443 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-473b5e60-ea32-4708-a57b-dfa7a81660fc tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:41.097878 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-473b5e60-ea32-4708-a57b-dfa7a81660fc tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:41.415347 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-9318dad7-5fe0-4e21-9da2-3a1c57bfd8cc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:41.419685 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-9318dad7-5fe0-4e21-9da2-3a1c57bfd8cc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: 08308b76-0df7-4c43-a434-6880034a8c54] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:41.424282 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9318dad7-5fe0-4e21-9da2-3a1c57bfd8cc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:41.425053 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9318dad7-5fe0-4e21-9da2-3a1c57bfd8cc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:41.426171 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9318dad7-5fe0-4e21-9da2-3a1c57bfd8cc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:41.426849 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9318dad7-5fe0-4e21-9da2-3a1c57bfd8cc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:41.492466 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-9318dad7-5fe0-4e21-9da2-3a1c57bfd8cc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:41.500789 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-9318dad7-5fe0-4e21-9da2-3a1c57bfd8cc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54" status: 200 len: 1301 microversion: 2.1 time: 0.089765 Jun 07 08:47:41.501416 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 460/927] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:41 2022] GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54 => generated 1301 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:41.883144 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-473b5e60-ea32-4708-a57b-dfa7a81660fc tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "POST /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.798993 Jun 07 08:47:41.884037 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 468/928] 10.222.0.17 () {60 vars in 1322 bytes} [Tue Jun 7 08:47:41 2022] POST /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30/os-volume_attachments => generated 194 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:47:42.518365 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-bd17add1-80e9-4dea-bd70-db2862add6e1 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:42.518963 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-bd17add1-80e9-4dea-bd70-db2862add6e1 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: 08308b76-0df7-4c43-a434-6880034a8c54] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:42.526312 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-bd17add1-80e9-4dea-bd70-db2862add6e1 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:42.526764 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-bd17add1-80e9-4dea-bd70-db2862add6e1 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:42.528718 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-bd17add1-80e9-4dea-bd70-db2862add6e1 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:42.529383 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-bd17add1-80e9-4dea-bd70-db2862add6e1 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:42.665755 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-bd17add1-80e9-4dea-bd70-db2862add6e1 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:42.673338 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-bd17add1-80e9-4dea-bd70-db2862add6e1 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54" status: 200 len: 1367 microversion: 2.1 time: 0.159244 Jun 07 08:47:42.673922 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 461/929] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:42 2022] GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:43.059051 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-0923d3fc-8e3f-4c66-9929-12bab74428ad req-c7acb0e5-99c6-43da-b90c-83f6a5b60a74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08308b76-0df7-4c43-a434-6880034a8c54", "tag": "f26913ff-23c8-416e-b118-034b1a42d415"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:47:43.068346 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-0923d3fc-8e3f-4c66-9929-12bab74428ad req-c7acb0e5-99c6-43da-b90c-83f6a5b60a74 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:43.069056 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-0923d3fc-8e3f-4c66-9929-12bab74428ad req-c7acb0e5-99c6-43da-b90c-83f6a5b60a74 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:43.081561 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-0923d3fc-8e3f-4c66-9929-12bab74428ad req-c7acb0e5-99c6-43da-b90c-83f6a5b60a74 service nova] Creating event network-changed:f26913ff-23c8-416e-b118-034b1a42d415 for instance 08308b76-0df7-4c43-a434-6880034a8c54 on hv-cinder-74014 Jun 07 08:47:43.086309 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-0923d3fc-8e3f-4c66-9929-12bab74428ad req-c7acb0e5-99c6-43da-b90c-83f6a5b60a74 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036091 Jun 07 08:47:43.090610 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 469/930] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:47:43.691323 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-d29f0442-d51d-4930-8f95-558265c151ce tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:43.691976 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-d29f0442-d51d-4930-8f95-558265c151ce tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: 08308b76-0df7-4c43-a434-6880034a8c54] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:43.698741 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d29f0442-d51d-4930-8f95-558265c151ce tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:43.699183 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d29f0442-d51d-4930-8f95-558265c151ce tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:43.699955 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d29f0442-d51d-4930-8f95-558265c151ce tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:43.700399 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d29f0442-d51d-4930-8f95-558265c151ce tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:44.048763 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-d29f0442-d51d-4930-8f95-558265c151ce tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:44.056237 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-d29f0442-d51d-4930-8f95-558265c151ce tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54" status: 200 len: 1367 microversion: 2.1 time: 0.369633 Jun 07 08:47:44.056784 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 462/931] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:43 2022] GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54 => generated 1367 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:45.074029 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-d5e647f7-479a-421a-8188-1d8cddc74461 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:45.074734 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-d5e647f7-479a-421a-8188-1d8cddc74461 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: 08308b76-0df7-4c43-a434-6880034a8c54] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:45.080890 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d5e647f7-479a-421a-8188-1d8cddc74461 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:45.081565 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d5e647f7-479a-421a-8188-1d8cddc74461 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:45.082144 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d5e647f7-479a-421a-8188-1d8cddc74461 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:45.082583 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d5e647f7-479a-421a-8188-1d8cddc74461 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:45.213282 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-d5e647f7-479a-421a-8188-1d8cddc74461 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:45.221356 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-d5e647f7-479a-421a-8188-1d8cddc74461 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54" status: 200 len: 1367 microversion: 2.1 time: 0.152107 Jun 07 08:47:45.221923 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 470/932] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:45 2022] GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:46.237261 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-aff8b102-815c-490a-940a-18d26d66578a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:46.237881 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-aff8b102-815c-490a-940a-18d26d66578a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: 08308b76-0df7-4c43-a434-6880034a8c54] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:46.244450 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-aff8b102-815c-490a-940a-18d26d66578a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:46.244901 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-aff8b102-815c-490a-940a-18d26d66578a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:46.245691 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-aff8b102-815c-490a-940a-18d26d66578a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:46.246129 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-aff8b102-815c-490a-940a-18d26d66578a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:46.377688 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-aff8b102-815c-490a-940a-18d26d66578a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:46.384987 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-aff8b102-815c-490a-940a-18d26d66578a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54" status: 200 len: 1367 microversion: 2.1 time: 0.151640 Jun 07 08:47:46.385568 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 463/933] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:46 2022] GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:47.402304 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-4c3bbe0a-1183-4bce-971b-041eaeec0d35 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:47.402916 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-4c3bbe0a-1183-4bce-971b-041eaeec0d35 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: 08308b76-0df7-4c43-a434-6880034a8c54] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:47.410191 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4c3bbe0a-1183-4bce-971b-041eaeec0d35 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:47.410643 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4c3bbe0a-1183-4bce-971b-041eaeec0d35 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:47.411406 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4c3bbe0a-1183-4bce-971b-041eaeec0d35 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:47.411844 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4c3bbe0a-1183-4bce-971b-041eaeec0d35 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:47.539542 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-4c3bbe0a-1183-4bce-971b-041eaeec0d35 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:47.547863 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-4c3bbe0a-1183-4bce-971b-041eaeec0d35 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54" status: 200 len: 1367 microversion: 2.1 time: 0.149626 Jun 07 08:47:47.548435 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 471/934] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:47 2022] GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:48.466789 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-71a5f7dc-eae5-433f-97b3-e62fc712dd91 req-a080f7fb-4ccb-4a06-a33d-197526743b07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08308b76-0df7-4c43-a434-6880034a8c54", "name": "network-vif-plugged", "status": "completed", "tag": "f26913ff-23c8-416e-b118-034b1a42d415"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:47:48.475903 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-71a5f7dc-eae5-433f-97b3-e62fc712dd91 req-a080f7fb-4ccb-4a06-a33d-197526743b07 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:48.476351 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-71a5f7dc-eae5-433f-97b3-e62fc712dd91 req-a080f7fb-4ccb-4a06-a33d-197526743b07 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:48.487898 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-71a5f7dc-eae5-433f-97b3-e62fc712dd91 req-a080f7fb-4ccb-4a06-a33d-197526743b07 service nova] Creating event network-vif-plugged:f26913ff-23c8-416e-b118-034b1a42d415 for instance 08308b76-0df7-4c43-a434-6880034a8c54 on hv-cinder-74014 Jun 07 08:47:48.493230 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-71a5f7dc-eae5-433f-97b3-e62fc712dd91 req-a080f7fb-4ccb-4a06-a33d-197526743b07 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030214 Jun 07 08:47:48.493861 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 464/935] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:47:48.565866 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-d2c042a1-fa3a-4483-9644-97788fc29116 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:48.566707 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-d2c042a1-fa3a-4483-9644-97788fc29116 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: 08308b76-0df7-4c43-a434-6880034a8c54] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:48.573898 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d2c042a1-fa3a-4483-9644-97788fc29116 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:48.574345 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d2c042a1-fa3a-4483-9644-97788fc29116 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:48.575121 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d2c042a1-fa3a-4483-9644-97788fc29116 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:48.575558 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d2c042a1-fa3a-4483-9644-97788fc29116 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:48.745801 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-d2c042a1-fa3a-4483-9644-97788fc29116 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:48.754306 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-d2c042a1-fa3a-4483-9644-97788fc29116 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54" status: 200 len: 1367 microversion: 2.1 time: 0.193744 Jun 07 08:47:48.754905 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 472/936] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:48 2022] GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:49.778137 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell0:SELECT=2 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:47:49.778855 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell0:SELECT=10 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:47:49.783248 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-f4decda5-d75d-48ff-bdc3-c8e0d9707295 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:49.783949 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-f4decda5-d75d-48ff-bdc3-c8e0d9707295 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: 08308b76-0df7-4c43-a434-6880034a8c54] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:49.790124 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f4decda5-d75d-48ff-bdc3-c8e0d9707295 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:49.790586 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f4decda5-d75d-48ff-bdc3-c8e0d9707295 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:49.791338 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f4decda5-d75d-48ff-bdc3-c8e0d9707295 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:49.791777 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f4decda5-d75d-48ff-bdc3-c8e0d9707295 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:49.941625 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-f4decda5-d75d-48ff-bdc3-c8e0d9707295 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:49.949333 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-f4decda5-d75d-48ff-bdc3-c8e0d9707295 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54" status: 200 len: 1367 microversion: 2.1 time: 0.172368 Jun 07 08:47:49.949906 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 465/937] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:49 2022] GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:50.965677 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-1161ad15-a874-494b-89c5-19a7235d9139 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:50.966326 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-1161ad15-a874-494b-89c5-19a7235d9139 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: 08308b76-0df7-4c43-a434-6880034a8c54] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:50.968752 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell0:SELECT=2 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:47:50.974069 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1161ad15-a874-494b-89c5-19a7235d9139 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:50.974519 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1161ad15-a874-494b-89c5-19a7235d9139 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:50.975283 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1161ad15-a874-494b-89c5-19a7235d9139 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:50.975725 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1161ad15-a874-494b-89c5-19a7235d9139 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:51.111069 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-1161ad15-a874-494b-89c5-19a7235d9139 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:51.118731 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-1161ad15-a874-494b-89c5-19a7235d9139 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54" status: 200 len: 1367 microversion: 2.1 time: 0.156878 Jun 07 08:47:51.119327 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 473/938] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:50 2022] GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:52.135868 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-44aac898-851d-4566-89bf-185a921acecc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:52.136535 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-44aac898-851d-4566-89bf-185a921acecc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: 08308b76-0df7-4c43-a434-6880034a8c54] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:52.144461 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-44aac898-851d-4566-89bf-185a921acecc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:52.144918 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-44aac898-851d-4566-89bf-185a921acecc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:52.145720 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-44aac898-851d-4566-89bf-185a921acecc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:52.146165 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-44aac898-851d-4566-89bf-185a921acecc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:52.272061 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-44aac898-851d-4566-89bf-185a921acecc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:52.279747 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-44aac898-851d-4566-89bf-185a921acecc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54" status: 200 len: 1367 microversion: 2.1 time: 0.148072 Jun 07 08:47:52.280851 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 466/939] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:52 2022] GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:53.297998 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-4a31d2d2-6dad-4a4d-b0ec-36535e495eed tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:53.298657 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-4a31d2d2-6dad-4a4d-b0ec-36535e495eed tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: 08308b76-0df7-4c43-a434-6880034a8c54] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:53.305650 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4a31d2d2-6dad-4a4d-b0ec-36535e495eed tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:53.306107 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4a31d2d2-6dad-4a4d-b0ec-36535e495eed tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:53.306895 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4a31d2d2-6dad-4a4d-b0ec-36535e495eed tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:53.307328 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4a31d2d2-6dad-4a4d-b0ec-36535e495eed tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:53.439760 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-4a31d2d2-6dad-4a4d-b0ec-36535e495eed tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:47:53.447179 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-4a31d2d2-6dad-4a4d-b0ec-36535e495eed tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54" status: 200 len: 1557 microversion: 2.1 time: 0.154034 Jun 07 08:47:53.447744 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 474/940] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:47:53 2022] GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:47:53.464000 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-4b9966c5-55d8-4c1b-8803-a859423f9ee5 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:47:53.464506 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-4b9966c5-55d8-4c1b-8803-a859423f9ee5 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: 08308b76-0df7-4c43-a434-6880034a8c54] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:47:53.471680 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4b9966c5-55d8-4c1b-8803-a859423f9ee5 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:53.472123 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4b9966c5-55d8-4c1b-8803-a859423f9ee5 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:53.472884 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4b9966c5-55d8-4c1b-8803-a859423f9ee5 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:53.473349 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4b9966c5-55d8-4c1b-8803-a859423f9ee5 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:53.561698 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-4b9966c5-55d8-4c1b-8803-a859423f9ee5 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101229 Jun 07 08:47:53.562441 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 467/941] 10.222.0.17 () {58 vars in 1274 bytes} [Tue Jun 7 08:47:53 2022] GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:47:54.643525 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-e143af85-fe36-4b97-b3d5-60da10b15a1d req-bfa3fae1-1289-4eba-8dc6-0a5716660cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08308b76-0df7-4c43-a434-6880034a8c54", "tag": "f26913ff-23c8-416e-b118-034b1a42d415"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:47:54.652212 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-e143af85-fe36-4b97-b3d5-60da10b15a1d req-bfa3fae1-1289-4eba-8dc6-0a5716660cb0 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:47:54.652666 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-e143af85-fe36-4b97-b3d5-60da10b15a1d req-bfa3fae1-1289-4eba-8dc6-0a5716660cb0 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:47:54.664641 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-e143af85-fe36-4b97-b3d5-60da10b15a1d req-bfa3fae1-1289-4eba-8dc6-0a5716660cb0 service nova] Creating event network-changed:f26913ff-23c8-416e-b118-034b1a42d415 for instance 08308b76-0df7-4c43-a434-6880034a8c54 on hv-cinder-74014 Jun 07 08:47:54.669826 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-e143af85-fe36-4b97-b3d5-60da10b15a1d req-bfa3fae1-1289-4eba-8dc6-0a5716660cb0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029928 Jun 07 08:47:54.671261 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 475/942] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:48:06.425243 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:48:06.426009 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=1 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:48:06.430016 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-9d6550c8-1643-4218-834e-fbc29c94d014 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:48:06.430518 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-9d6550c8-1643-4218-834e-fbc29c94d014 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: 09a4d297-6aca-4a31-b0c5-25d8fb05af30] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:06.436279 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9d6550c8-1643-4218-834e-fbc29c94d014 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:06.436734 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9d6550c8-1643-4218-834e-fbc29c94d014 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:06.438038 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9d6550c8-1643-4218-834e-fbc29c94d014 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:06.443867 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9d6550c8-1643-4218-834e-fbc29c94d014 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:06.522069 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.objects.instance [None req-9d6550c8-1643-4218-834e-fbc29c94d014 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lazy-loading 'services' on Instance uuid 09a4d297-6aca-4a31-b0c5-25d8fb05af30 {{(pid=129726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:48:06.683893 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-9d6550c8-1643-4218-834e-fbc29c94d014 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "DELETE /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30/os-volume_attachments/96d590da-65bd-40e7-b8ea-262ea7f0aa90" status: 202 len: 0 microversion: 2.1 time: 0.259812 Jun 07 08:48:06.684486 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 468/943] 10.222.0.17 () {58 vars in 1415 bytes} [Tue Jun 7 08:48:06 2022] DELETE /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30/os-volume_attachments/96d590da-65bd-40e7-b8ea-262ea7f0aa90 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 08:48:07.796604 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_api:SELECT=28 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:48:07.797768 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:48:07.801988 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-b01dcb2e-59d0-4847-b644-57123dcbf166 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:48:07.802569 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-b01dcb2e-59d0-4847-b644-57123dcbf166 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: 09a4d297-6aca-4a31-b0c5-25d8fb05af30] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:07.808508 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b01dcb2e-59d0-4847-b644-57123dcbf166 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:07.808958 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b01dcb2e-59d0-4847-b644-57123dcbf166 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:07.809732 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b01dcb2e-59d0-4847-b644-57123dcbf166 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:07.810163 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b01dcb2e-59d0-4847-b644-57123dcbf166 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:07.836648 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-b01dcb2e-59d0-4847-b644-57123dcbf166 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: 09a4d297-6aca-4a31-b0c5-25d8fb05af30] Going to try to terminate instance {{(pid=129725) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 08:48:08.107631 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-b01dcb2e-59d0-4847-b644-57123dcbf166 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "DELETE /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30" status: 204 len: 0 microversion: 2.1 time: 0.312890 Jun 07 08:48:08.108173 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 476/944] 10.222.0.17 () {58 vars in 1238 bytes} [Tue Jun 7 08:48:07 2022] DELETE /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 07 08:48:08.117298 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-f6bc77cd-a731-4dbb-9eaf-9f1e78f66a23 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:48:08.120243 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-f6bc77cd-a731-4dbb-9eaf-9f1e78f66a23 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: 09a4d297-6aca-4a31-b0c5-25d8fb05af30] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:08.124259 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f6bc77cd-a731-4dbb-9eaf-9f1e78f66a23 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:08.125247 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f6bc77cd-a731-4dbb-9eaf-9f1e78f66a23 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:08.126011 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f6bc77cd-a731-4dbb-9eaf-9f1e78f66a23 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:08.126448 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f6bc77cd-a731-4dbb-9eaf-9f1e78f66a23 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:08.258093 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-f6bc77cd-a731-4dbb-9eaf-9f1e78f66a23 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c3d3030c6a4d42a941ae489c5bf125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287c3c3374034e3899d7c8b7d970a738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:48:08.266272 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-f6bc77cd-a731-4dbb-9eaf-9f1e78f66a23 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30" status: 200 len: 1513 microversion: 2.1 time: 0.153582 Jun 07 08:48:08.266841 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 469/945] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:48:08 2022] GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:48:09.284720 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-4c7afa78-c5f7-493b-95b7-9d4349c9badf tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:48:09.285458 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-4c7afa78-c5f7-493b-95b7-9d4349c9badf tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: 09a4d297-6aca-4a31-b0c5-25d8fb05af30] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:09.292194 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4c7afa78-c5f7-493b-95b7-9d4349c9badf tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:09.292643 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4c7afa78-c5f7-493b-95b7-9d4349c9badf tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:09.293444 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4c7afa78-c5f7-493b-95b7-9d4349c9badf tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:09.293866 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4c7afa78-c5f7-493b-95b7-9d4349c9badf tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:09.424181 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-4c7afa78-c5f7-493b-95b7-9d4349c9badf tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c3d3030c6a4d42a941ae489c5bf125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287c3c3374034e3899d7c8b7d970a738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:48:09.431633 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-4c7afa78-c5f7-493b-95b7-9d4349c9badf tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30" status: 200 len: 1513 microversion: 2.1 time: 0.151769 Jun 07 08:48:09.432194 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 477/946] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:48:09 2022] GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:48:10.404399 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-82be0642-311c-4e62-bded-1f46ddc38f17 req-14f44902-493f-4be6-8e6d-6f75aabae144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09a4d297-6aca-4a31-b0c5-25d8fb05af30", "name": "network-vif-deleted", "tag": "c8e2855e-c2c9-4dd2-8502-7dedb744855c"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:48:10.412812 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-82be0642-311c-4e62-bded-1f46ddc38f17 req-14f44902-493f-4be6-8e6d-6f75aabae144 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:10.414126 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-82be0642-311c-4e62-bded-1f46ddc38f17 req-14f44902-493f-4be6-8e6d-6f75aabae144 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:10.424318 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-82be0642-311c-4e62-bded-1f46ddc38f17 req-14f44902-493f-4be6-8e6d-6f75aabae144 service nova] Creating event network-vif-deleted:c8e2855e-c2c9-4dd2-8502-7dedb744855c for instance 09a4d297-6aca-4a31-b0c5-25d8fb05af30 on hv-cinder-74014 Jun 07 08:48:10.429333 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-82be0642-311c-4e62-bded-1f46ddc38f17 req-14f44902-493f-4be6-8e6d-6f75aabae144 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028739 Jun 07 08:48:10.429913 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 470/947] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:48:10.448984 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-21f3f58a-6e47-443b-aa7a-3b9fa52d7cf2 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:48:10.449630 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-21f3f58a-6e47-443b-aa7a-3b9fa52d7cf2 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: 09a4d297-6aca-4a31-b0c5-25d8fb05af30] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:10.456685 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-21f3f58a-6e47-443b-aa7a-3b9fa52d7cf2 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:10.457169 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-21f3f58a-6e47-443b-aa7a-3b9fa52d7cf2 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:10.457933 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-21f3f58a-6e47-443b-aa7a-3b9fa52d7cf2 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:10.458501 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-21f3f58a-6e47-443b-aa7a-3b9fa52d7cf2 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:10.521345 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-21f3f58a-6e47-443b-aa7a-3b9fa52d7cf2 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c3d3030c6a4d42a941ae489c5bf125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287c3c3374034e3899d7c8b7d970a738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:48:10.529328 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-21f3f58a-6e47-443b-aa7a-3b9fa52d7cf2 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30" status: 200 len: 1471 microversion: 2.1 time: 0.084110 Jun 07 08:48:10.529915 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 478/948] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:48:10 2022] GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30 => generated 1471 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:48:11.547996 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-e0dfec7c-663a-49b3-b29f-7e383eb87aeb tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:48:11.548694 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-e0dfec7c-663a-49b3-b29f-7e383eb87aeb tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: 09a4d297-6aca-4a31-b0c5-25d8fb05af30] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:11.554900 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e0dfec7c-663a-49b3-b29f-7e383eb87aeb tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:11.555348 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e0dfec7c-663a-49b3-b29f-7e383eb87aeb tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:11.556130 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e0dfec7c-663a-49b3-b29f-7e383eb87aeb tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:11.556565 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e0dfec7c-663a-49b3-b29f-7e383eb87aeb tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:11.569579 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.wsgi [None req-e0dfec7c-663a-49b3-b29f-7e383eb87aeb tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] HTTP exception thrown: Instance 09a4d297-6aca-4a31-b0c5-25d8fb05af30 could not be found. Jun 07 08:48:11.571177 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-e0dfec7c-663a-49b3-b29f-7e383eb87aeb tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Request method failure captured: Jun 07 08:48:11.571177 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: request: GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30 HTTP/1.1 Jun 07 08:48:11.571177 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept: application/json Jun 07 08:48:11.571177 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept-Encoding: identity Jun 07 08:48:11.571177 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Connection: close Jun 07 08:48:11.571177 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Length: 0 Jun 07 08:48:11.571177 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Type: application/json Jun 07 08:48:11.571177 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Host: 10.222.0.17 Jun 07 08:48:11.571177 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Openstack-System-Scope: None Jun 07 08:48:11.571177 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: User-Agent: python-urllib3/1.26.9 Jun 07 08:48:11.571177 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Auth-Token: gAAAAABinxCJ2balZJT7kf6PtUgC-06MPqCZUFGn-Ts2ZTd1Qh6vW5svO-fHHUFzqo9wNfALk0FdiJciDamDNuTFV52Jq1Mv8jvy8wjgyshRUyvKHjNowUFN4fFp324I9041_j4tKcpbmmwxoQoW0IldaWS1iny5Wyt3Ru9FYs9KY-A-1zx4PkI Jun 07 08:48:11.571177 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Id: None Jun 07 08:48:11.571177 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Name: None Jun 07 08:48:11.571177 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Identity-Status: Confirmed Jun 07 08:48:11.571177 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Is-Admin-Project: True Jun 07 08:48:11.571177 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Id: default Jun 07 08:48:11.571177 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Name: Default Jun 07 08:48:11.571177 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Id: 287c3c3374034e3899d7c8b7d970a738 Jun 07 08:48:11.571177 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Name: tempest-VolumesSnapshotTestJSON-586971830 Jun 07 08:48:11.571177 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Role: reader,member Jun 07 08:48:11.571177 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Roles: reader,member Jun 07 08:48:11.572977 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/287c3c3374034e3899d7c8b7d970a738"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/287c3c3374034e3899d7c8b7d970a738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_287c3c3374034e3899d7c8b7d970a738", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/287c3c3374034e3899d7c8b7d970a738"}]}] Jun 07 08:48:11.572977 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant: tempest-VolumesSnapshotTestJSON-586971830 Jun 07 08:48:11.572977 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Id: 287c3c3374034e3899d7c8b7d970a738 Jun 07 08:48:11.572977 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-586971830 Jun 07 08:48:11.572977 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User: tempest-VolumesSnapshotTestJSON-586971830-project Jun 07 08:48:11.572977 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Id: default Jun 07 08:48:11.572977 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Name: Default Jun 07 08:48:11.572977 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Id: 03c3d3030c6a4d42a941ae489c5bf125 Jun 07 08:48:11.572977 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Name: tempest-VolumesSnapshotTestJSON-586971830-project Jun 07 08:48:11.572977 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: method: > Jun 07 08:48:11.572977 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: exception: Instance 09a4d297-6aca-4a31-b0c5-25d8fb05af30 could not be found. Jun 07 08:48:11.572977 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: action_args: {'id': '09a4d297-6aca-4a31-b0c5-25d8fb05af30'} Jun 07 08:48:11.573990 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:48:11.573990 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:48:11.573990 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:48:11.573990 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:48:11.573990 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:48:11.573990 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:48:11.573990 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:48:11.573990 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:48:11.573990 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:48:11.573990 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:48:11.573990 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09a4d297-6aca-4a31-b0c5-25d8fb05af30 could not be found. Jun 07 08:48:11.573990 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:48:11.573990 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:48:11.573990 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:48:11.573990 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:48:11.573990 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:48:11.573990 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:48:11.573990 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:48:11.573990 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:48:11.573990 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:48:11.575550 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:48:11.575550 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 08:48:11.575550 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 08:48:11.575550 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:48:11.575550 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:48:11.575550 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:48:11.575550 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:48:11.575550 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09a4d297-6aca-4a31-b0c5-25d8fb05af30 could not be found. Jun 07 08:48:11.575550 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:48:11.575550 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:48:11.575550 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:48:11.575550 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:48:11.575550 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:48:11.575550 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:48:11.575550 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:48:11.575550 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:48:11.575550 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09a4d297-6aca-4a31-b0c5-25d8fb05af30 could not be found. Jun 07 08:48:11.575550 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:48:11.577275 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-e0dfec7c-663a-49b3-b29f-7e383eb87aeb tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Returning 404 to user: Instance 09a4d297-6aca-4a31-b0c5-25d8fb05af30 could not be found. {{(pid=129726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:48:11.577275 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-e0dfec7c-663a-49b3-b29f-7e383eb87aeb tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30" status: 404 len: 111 microversion: 2.1 time: 0.029277 Jun 07 08:48:11.577275 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 471/949] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:48:11 2022] GET /compute/v2.1/servers/09a4d297-6aca-4a31-b0c5-25d8fb05af30 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:48:15.520830 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 08:48:15.521444 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Tue Jun 7 08:48:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 08:48:21.917675 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-acd6a6c0-c30e-4fc8-9ca3-373218041415 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1089441971", "imageRef": "c04b0a92-7675-47c3-bcc2-8a2a59b997c3", "flavorRef": "452", "networks": [{"uuid": "fcce195b-6407-4d12-9ce4-532cb336c938"}]}} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:48:21.924879 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:48:21.925551 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:48:22.080765 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.network.neutron [None req-acd6a6c0-c30e-4fc8-9ca3-373218041415 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] validate_networks() for [('fcce195b-6407-4d12-9ce4-532cb336c938', None, None, None, None, None)] {{(pid=129725) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 08:48:22.439050 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-acd6a6c0-c30e-4fc8-9ca3-373218041415 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Flavor limits 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 08:48:22.439492 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-acd6a6c0-c30e-4fc8-9ca3-373218041415 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Image limits 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 08:48:22.439950 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-acd6a6c0-c30e-4fc8-9ca3-373218041415 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Flavor pref 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 08:48:22.440355 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-acd6a6c0-c30e-4fc8-9ca3-373218041415 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Image pref 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 08:48:22.440766 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-acd6a6c0-c30e-4fc8-9ca3-373218041415 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 08:48:22.451097 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-acd6a6c0-c30e-4fc8-9ca3-373218041415 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:22.451097 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-acd6a6c0-c30e-4fc8-9ca3-373218041415 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:22.451097 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-acd6a6c0-c30e-4fc8-9ca3-373218041415 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:22.451432 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-acd6a6c0-c30e-4fc8-9ca3-373218041415 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:22.468628 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.quota [None req-acd6a6c0-c30e-4fc8-9ca3-373218041415 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Getting quotas for project 287c3c3374034e3899d7c8b7d970a738. Resources: {'ram', 'cores', 'instances'} {{(pid=129725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 08:48:22.473304 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.quota [None req-acd6a6c0-c30e-4fc8-9ca3-373218041415 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Getting quotas for user 03c3d3030c6a4d42a941ae489c5bf125 and project 287c3c3374034e3899d7c8b7d970a738. Resources: {'ram', 'cores', 'instances'} {{(pid=129725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 08:48:22.484127 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-acd6a6c0-c30e-4fc8-9ca3-373218041415 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Going to run 1 instances... {{(pid=129725) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 08:48:22.486441 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-acd6a6c0-c30e-4fc8-9ca3-373218041415 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: e234b6e6-1592-4038-acd2-8c1c60068dc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c04b0a92-7675-47c3-bcc2-8a2a59b997c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 08:48:22.605519 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-acd6a6c0-c30e-4fc8-9ca3-373218041415 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.691878 Jun 07 08:48:22.606160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 479/950] 10.222.0.17 () {60 vars in 1146 bytes} [Tue Jun 7 08:48:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 08:48:22.616447 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-0c72e742-d4be-4a9b-84d1-1de0b821132d tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:48:22.617106 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-0c72e742-d4be-4a9b-84d1-1de0b821132d tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: e234b6e6-1592-4038-acd2-8c1c60068dc9] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:22.619611 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_api:SELECT=8 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:48:22.620287 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:48:22.726965 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-0c72e742-d4be-4a9b-84d1-1de0b821132d tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c3d3030c6a4d42a941ae489c5bf125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287c3c3374034e3899d7c8b7d970a738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:48:22.734550 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-0c72e742-d4be-4a9b-84d1-1de0b821132d tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9" status: 200 len: 1219 microversion: 2.1 time: 0.122067 Jun 07 08:48:22.735109 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 472/951] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:48:22 2022] GET /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9 => generated 1219 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:48:23.752465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-9500b106-a44d-4186-bd4b-e04fa89b4339 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:48:23.753252 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-9500b106-a44d-4186-bd4b-e04fa89b4339 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: e234b6e6-1592-4038-acd2-8c1c60068dc9] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:23.761063 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9500b106-a44d-4186-bd4b-e04fa89b4339 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:23.761063 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9500b106-a44d-4186-bd4b-e04fa89b4339 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:23.761409 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9500b106-a44d-4186-bd4b-e04fa89b4339 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:23.761855 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9500b106-a44d-4186-bd4b-e04fa89b4339 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:23.824558 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-9500b106-a44d-4186-bd4b-e04fa89b4339 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c3d3030c6a4d42a941ae489c5bf125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287c3c3374034e3899d7c8b7d970a738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:48:23.832095 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-9500b106-a44d-4186-bd4b-e04fa89b4339 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9" status: 200 len: 1215 microversion: 2.1 time: 0.084245 Jun 07 08:48:23.833326 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 480/952] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:48:23 2022] GET /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9 => generated 1215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:48:24.850718 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-3c38d7ad-1f6b-4af7-8b30-18b2881a0e4e tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:48:24.852117 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-3c38d7ad-1f6b-4af7-8b30-18b2881a0e4e tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: e234b6e6-1592-4038-acd2-8c1c60068dc9] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:24.860004 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3c38d7ad-1f6b-4af7-8b30-18b2881a0e4e tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:24.860456 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3c38d7ad-1f6b-4af7-8b30-18b2881a0e4e tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:24.861292 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3c38d7ad-1f6b-4af7-8b30-18b2881a0e4e tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:24.861732 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3c38d7ad-1f6b-4af7-8b30-18b2881a0e4e tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:24.931844 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-3c38d7ad-1f6b-4af7-8b30-18b2881a0e4e tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c3d3030c6a4d42a941ae489c5bf125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287c3c3374034e3899d7c8b7d970a738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:48:24.939707 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-3c38d7ad-1f6b-4af7-8b30-18b2881a0e4e tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9" status: 200 len: 1277 microversion: 2.1 time: 0.092833 Jun 07 08:48:24.940962 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 473/953] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:48:24 2022] GET /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9 => generated 1277 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:48:25.956934 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-45aff33d-79a1-4b4a-9980-7eb8cd05ed67 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:48:25.957578 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-45aff33d-79a1-4b4a-9980-7eb8cd05ed67 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: e234b6e6-1592-4038-acd2-8c1c60068dc9] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:25.963631 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-45aff33d-79a1-4b4a-9980-7eb8cd05ed67 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:25.964082 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-45aff33d-79a1-4b4a-9980-7eb8cd05ed67 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:25.964834 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-45aff33d-79a1-4b4a-9980-7eb8cd05ed67 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:25.965297 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-45aff33d-79a1-4b4a-9980-7eb8cd05ed67 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:26.065831 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-20631cb9-8164-4656-8610-b35eadbb3d30 req-db139f5f-4193-4733-9c5b-15cb92605ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e234b6e6-1592-4038-acd2-8c1c60068dc9", "tag": "de18f595-5923-47e5-8b1f-6650f6a1d1e2"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:48:26.074572 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-20631cb9-8164-4656-8610-b35eadbb3d30 req-db139f5f-4193-4733-9c5b-15cb92605ac9 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:26.077258 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-20631cb9-8164-4656-8610-b35eadbb3d30 req-db139f5f-4193-4733-9c5b-15cb92605ac9 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:26.086728 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-20631cb9-8164-4656-8610-b35eadbb3d30 req-db139f5f-4193-4733-9c5b-15cb92605ac9 service nova] Creating event network-changed:de18f595-5923-47e5-8b1f-6650f6a1d1e2 for instance e234b6e6-1592-4038-acd2-8c1c60068dc9 on hv-cinder-74014 Jun 07 08:48:26.092094 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-20631cb9-8164-4656-8610-b35eadbb3d30 req-db139f5f-4193-4733-9c5b-15cb92605ac9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029919 Jun 07 08:48:26.093155 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 474/954] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:48:26.186740 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-45aff33d-79a1-4b4a-9980-7eb8cd05ed67 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c3d3030c6a4d42a941ae489c5bf125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287c3c3374034e3899d7c8b7d970a738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:48:26.189388 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-45aff33d-79a1-4b4a-9980-7eb8cd05ed67 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9" status: 200 len: 1319 microversion: 2.1 time: 0.236459 Jun 07 08:48:26.189996 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 481/955] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:48:25 2022] GET /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9 => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:48:27.206767 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-953ac6af-f774-42f7-8356-8bf0de6c7305 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:48:27.207462 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-953ac6af-f774-42f7-8356-8bf0de6c7305 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: e234b6e6-1592-4038-acd2-8c1c60068dc9] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:27.214053 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-953ac6af-f774-42f7-8356-8bf0de6c7305 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:27.214496 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-953ac6af-f774-42f7-8356-8bf0de6c7305 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:27.215283 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-953ac6af-f774-42f7-8356-8bf0de6c7305 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:27.215713 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-953ac6af-f774-42f7-8356-8bf0de6c7305 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:27.348803 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-953ac6af-f774-42f7-8356-8bf0de6c7305 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c3d3030c6a4d42a941ae489c5bf125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287c3c3374034e3899d7c8b7d970a738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:48:27.356199 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-953ac6af-f774-42f7-8356-8bf0de6c7305 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9" status: 200 len: 1319 microversion: 2.1 time: 0.153630 Jun 07 08:48:27.356757 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 475/956] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:48:27 2022] GET /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:48:28.378465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-c1b7ec7c-7dc4-4324-85ef-d32b93174c5b tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:48:28.379591 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-c1b7ec7c-7dc4-4324-85ef-d32b93174c5b tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: e234b6e6-1592-4038-acd2-8c1c60068dc9] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:28.386057 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c1b7ec7c-7dc4-4324-85ef-d32b93174c5b tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:28.386515 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c1b7ec7c-7dc4-4324-85ef-d32b93174c5b tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:28.387281 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c1b7ec7c-7dc4-4324-85ef-d32b93174c5b tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:28.387722 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c1b7ec7c-7dc4-4324-85ef-d32b93174c5b tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:28.518762 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-c1b7ec7c-7dc4-4324-85ef-d32b93174c5b tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c3d3030c6a4d42a941ae489c5bf125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287c3c3374034e3899d7c8b7d970a738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:48:28.526906 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-c1b7ec7c-7dc4-4324-85ef-d32b93174c5b tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9" status: 200 len: 1319 microversion: 2.1 time: 0.152201 Jun 07 08:48:28.527506 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 482/957] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:48:28 2022] GET /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:48:29.543786 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-bb1ebaa9-b9f4-47a7-9452-7128ff4710bd tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:48:29.544393 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-bb1ebaa9-b9f4-47a7-9452-7128ff4710bd tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: e234b6e6-1592-4038-acd2-8c1c60068dc9] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:29.550988 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-bb1ebaa9-b9f4-47a7-9452-7128ff4710bd tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:29.551444 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-bb1ebaa9-b9f4-47a7-9452-7128ff4710bd tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:29.552867 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-bb1ebaa9-b9f4-47a7-9452-7128ff4710bd tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:29.553337 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-bb1ebaa9-b9f4-47a7-9452-7128ff4710bd tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:29.682334 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-bb1ebaa9-b9f4-47a7-9452-7128ff4710bd tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c3d3030c6a4d42a941ae489c5bf125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287c3c3374034e3899d7c8b7d970a738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:48:29.689691 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-bb1ebaa9-b9f4-47a7-9452-7128ff4710bd tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9" status: 200 len: 1319 microversion: 2.1 time: 0.149956 Jun 07 08:48:29.690252 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 476/958] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:48:29 2022] GET /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:48:30.672626 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-43ad3ae0-06f9-4b13-a912-c3d9d9a254b7 req-04ad0371-cc3b-4b36-9128-663ba23c5b12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e234b6e6-1592-4038-acd2-8c1c60068dc9", "name": "network-vif-plugged", "status": "completed", "tag": "de18f595-5923-47e5-8b1f-6650f6a1d1e2"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:48:30.681669 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-43ad3ae0-06f9-4b13-a912-c3d9d9a254b7 req-04ad0371-cc3b-4b36-9128-663ba23c5b12 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:30.682111 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-43ad3ae0-06f9-4b13-a912-c3d9d9a254b7 req-04ad0371-cc3b-4b36-9128-663ba23c5b12 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:30.694631 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-43ad3ae0-06f9-4b13-a912-c3d9d9a254b7 req-04ad0371-cc3b-4b36-9128-663ba23c5b12 service nova] Creating event network-vif-plugged:de18f595-5923-47e5-8b1f-6650f6a1d1e2 for instance e234b6e6-1592-4038-acd2-8c1c60068dc9 on hv-cinder-74014 Jun 07 08:48:30.699941 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-43ad3ae0-06f9-4b13-a912-c3d9d9a254b7 req-04ad0371-cc3b-4b36-9128-663ba23c5b12 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030905 Jun 07 08:48:30.700664 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 483/959] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:48:30.706669 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-ee6031b1-7a8d-4770-a2f7-fde2d91e197d tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:48:30.707287 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-ee6031b1-7a8d-4770-a2f7-fde2d91e197d tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: e234b6e6-1592-4038-acd2-8c1c60068dc9] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:30.714286 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ee6031b1-7a8d-4770-a2f7-fde2d91e197d tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:30.714730 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ee6031b1-7a8d-4770-a2f7-fde2d91e197d tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:30.715501 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ee6031b1-7a8d-4770-a2f7-fde2d91e197d tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:30.715969 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ee6031b1-7a8d-4770-a2f7-fde2d91e197d tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:30.849649 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-ee6031b1-7a8d-4770-a2f7-fde2d91e197d tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c3d3030c6a4d42a941ae489c5bf125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287c3c3374034e3899d7c8b7d970a738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:48:30.857097 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-ee6031b1-7a8d-4770-a2f7-fde2d91e197d tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9" status: 200 len: 1319 microversion: 2.1 time: 0.154541 Jun 07 08:48:30.857744 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 477/960] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:48:30 2022] GET /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:48:31.875242 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-01b59876-179e-425c-8e18-2060e917a9ab tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:48:31.877115 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-01b59876-179e-425c-8e18-2060e917a9ab tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: e234b6e6-1592-4038-acd2-8c1c60068dc9] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:31.882661 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-01b59876-179e-425c-8e18-2060e917a9ab tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:31.883115 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-01b59876-179e-425c-8e18-2060e917a9ab tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:31.883871 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-01b59876-179e-425c-8e18-2060e917a9ab tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:31.884315 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-01b59876-179e-425c-8e18-2060e917a9ab tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:32.013502 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-01b59876-179e-425c-8e18-2060e917a9ab tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c3d3030c6a4d42a941ae489c5bf125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287c3c3374034e3899d7c8b7d970a738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:48:32.019000 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-01b59876-179e-425c-8e18-2060e917a9ab tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9" status: 200 len: 1319 microversion: 2.1 time: 0.148323 Jun 07 08:48:32.019575 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 484/961] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:48:31 2022] GET /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:48:33.037030 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-2374eb6e-34b0-42f4-82b3-8b5723990f5d tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:48:33.037597 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-2374eb6e-34b0-42f4-82b3-8b5723990f5d tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: e234b6e6-1592-4038-acd2-8c1c60068dc9] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:33.040142 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell0:SELECT=2 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:48:33.045009 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2374eb6e-34b0-42f4-82b3-8b5723990f5d tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:33.045471 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2374eb6e-34b0-42f4-82b3-8b5723990f5d tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:33.046239 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2374eb6e-34b0-42f4-82b3-8b5723990f5d tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:33.046675 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2374eb6e-34b0-42f4-82b3-8b5723990f5d tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:33.181838 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-2374eb6e-34b0-42f4-82b3-8b5723990f5d tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c3d3030c6a4d42a941ae489c5bf125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287c3c3374034e3899d7c8b7d970a738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:48:33.187586 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-2374eb6e-34b0-42f4-82b3-8b5723990f5d tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9" status: 200 len: 1507 microversion: 2.1 time: 0.154567 Jun 07 08:48:33.188159 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 478/962] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:48:33 2022] GET /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:48:33.204591 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-1d5a77c7-e8b8-4f68-b848-0b88be4f39c7 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f3d6851-1391-4c51-b433-6155fd8c71a5", "device": "/dev/sdb"}} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:48:33.205708 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-1d5a77c7-e8b8-4f68-b848-0b88be4f39c7 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: e234b6e6-1592-4038-acd2-8c1c60068dc9] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:33.207651 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell0:SELECT=2 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:48:33.208406 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell0:SELECT=6 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:48:33.213517 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1d5a77c7-e8b8-4f68-b848-0b88be4f39c7 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:33.213961 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1d5a77c7-e8b8-4f68-b848-0b88be4f39c7 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:33.214717 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1d5a77c7-e8b8-4f68-b848-0b88be4f39c7 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:33.215155 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1d5a77c7-e8b8-4f68-b848-0b88be4f39c7 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:33.893251 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-1d5a77c7-e8b8-4f68-b848-0b88be4f39c7 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "POST /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.692496 Jun 07 08:48:33.893850 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 485/963] 10.222.0.17 () {60 vars in 1322 bytes} [Tue Jun 7 08:48:33 2022] POST /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9/os-volume_attachments => generated 194 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:48:38.543321 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-4fb9a204-0fd1-4f82-a160-aa3a30333d9f tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:48:38.543895 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-4fb9a204-0fd1-4f82-a160-aa3a30333d9f tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: 08308b76-0df7-4c43-a434-6880034a8c54] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:38.550453 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4fb9a204-0fd1-4f82-a160-aa3a30333d9f tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:38.550876 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4fb9a204-0fd1-4f82-a160-aa3a30333d9f tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:38.551628 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4fb9a204-0fd1-4f82-a160-aa3a30333d9f tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:38.552063 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4fb9a204-0fd1-4f82-a160-aa3a30333d9f tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:38.574788 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-4fb9a204-0fd1-4f82-a160-aa3a30333d9f tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54/ips" status: 200 len: 150 microversion: 2.1 time: 0.035452 Jun 07 08:48:38.575349 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 479/964] 10.222.0.17 () {58 vars in 1247 bytes} [Tue Jun 7 08:48:38 2022] GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:48:40.115056 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-3db59eb6-ef8b-4299-ae26-cb4634d3c448 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44879a90-237c-4edf-8827-8f4a2ae7acdd"}} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:48:40.116182 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-3db59eb6-ef8b-4299-ae26-cb4634d3c448 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: 08308b76-0df7-4c43-a434-6880034a8c54] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:40.122971 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3db59eb6-ef8b-4299-ae26-cb4634d3c448 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:40.123499 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3db59eb6-ef8b-4299-ae26-cb4634d3c448 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:40.124264 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3db59eb6-ef8b-4299-ae26-cb4634d3c448 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:40.124690 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3db59eb6-ef8b-4299-ae26-cb4634d3c448 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:41.025513 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-3db59eb6-ef8b-4299-ae26-cb4634d3c448 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "POST /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.914603 Jun 07 08:48:41.026433 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 486/965] 10.222.0.17 () {60 vars in 1322 bytes} [Tue Jun 7 08:48:40 2022] POST /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54/os-volume_attachments => generated 194 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:48:50.650103 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-437ebf54-01c6-412e-885c-25b50c5b7a87 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44879a90-237c-4edf-8827-8f4a2ae7acdd"}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:48:50.651872 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-437ebf54-01c6-412e-885c-25b50c5b7a87 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: 08308b76-0df7-4c43-a434-6880034a8c54] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:50.654307 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_api:SELECT=18 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:48:50.654940 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=36 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:48:50.660060 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-437ebf54-01c6-412e-885c-25b50c5b7a87 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:50.660511 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-437ebf54-01c6-412e-885c-25b50c5b7a87 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:50.661317 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-437ebf54-01c6-412e-885c-25b50c5b7a87 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:50.661782 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-437ebf54-01c6-412e-885c-25b50c5b7a87 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:50.749518 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.wsgi [None req-437ebf54-01c6-412e-885c-25b50c5b7a87 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] HTTP exception thrown: Invalid volume: volume 44879a90-237c-4edf-8827-8f4a2ae7acdd is already attached to instances: 08308b76-0df7-4c43-a434-6880034a8c54 Jun 07 08:48:50.751355 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-437ebf54-01c6-412e-885c-25b50c5b7a87 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Request method failure captured: Jun 07 08:48:50.751355 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: request: POST /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54/os-volume_attachments HTTP/1.1 Jun 07 08:48:50.751355 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept: application/json Jun 07 08:48:50.751355 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept-Encoding: identity Jun 07 08:48:50.751355 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Connection: close Jun 07 08:48:50.751355 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Length: 74 Jun 07 08:48:50.751355 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Type: application/json Jun 07 08:48:50.751355 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Host: 10.222.0.17 Jun 07 08:48:50.751355 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Openstack-System-Scope: None Jun 07 08:48:50.751355 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: User-Agent: python-urllib3/1.26.9 Jun 07 08:48:50.751355 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Auth-Token: gAAAAABinxAgj5C7ouE1N-aaB4GYPlt92HgnY7l_4qNjeb7MhcXewkqTDq3SwhJjBOupqPwAwi-EUO3Doxu5eOmMdEwFCWQlkuqeuPwgDsRWAIP7QSDJjzl4qrePMCoCSyDT0Sg0QJjM04PVEJfbaffcjJA3z-4CjpQwrMDzvrui6SNaABiQiRQ Jun 07 08:48:50.751355 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Id: None Jun 07 08:48:50.751355 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Name: None Jun 07 08:48:50.751355 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Identity-Status: Confirmed Jun 07 08:48:50.751355 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Is-Admin-Project: True Jun 07 08:48:50.751355 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Id: default Jun 07 08:48:50.751355 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Name: Default Jun 07 08:48:50.751355 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Id: 0899cad1b7c64a0199b3466d4c7cfefb Jun 07 08:48:50.751355 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:48:50.751355 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Role: reader,member Jun 07 08:48:50.751355 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Roles: reader,member Jun 07 08:48:50.753150 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0899cad1b7c64a0199b3466d4c7cfefb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0899cad1b7c64a0199b3466d4c7cfefb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0899cad1b7c64a0199b3466d4c7cfefb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0899cad1b7c64a0199b3466d4c7cfefb"}]}] Jun 07 08:48:50.753150 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:48:50.753150 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Id: 0899cad1b7c64a0199b3466d4c7cfefb Jun 07 08:48:50.753150 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:48:50.753150 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User: tempest-AttachVolumeNegativeTest-1278776647-project Jun 07 08:48:50.753150 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Id: default Jun 07 08:48:50.753150 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Name: Default Jun 07 08:48:50.753150 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Id: 52ddf59fe764404eb1c6ee745e21d352 Jun 07 08:48:50.753150 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Name: tempest-AttachVolumeNegativeTest-1278776647-project Jun 07 08:48:50.753150 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Jun 07 08:48:50.753150 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: {"volumeAttachment": {"volumeId": "44879a90-237c-4edf-8827-8f4a2ae7acdd"}} Jun 07 08:48:50.753150 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: method: > Jun 07 08:48:50.754135 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: exception: Invalid volume: volume 44879a90-237c-4edf-8827-8f4a2ae7acdd is already attached to instances: 08308b76-0df7-4c43-a434-6880034a8c54 Jun 07 08:48:50.754135 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: action_args: {'server_id': '08308b76-0df7-4c43-a434-6880034a8c54', 'body': {'volumeAttachment': {'volumeId': '44879a90-237c-4edf-8827-8f4a2ae7acdd'}}} Jun 07 08:48:50.754135 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:48:50.754135 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:48:50.754135 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 07 08:48:50.754135 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 07 08:48:50.754135 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 07 08:48:50.754135 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 07 08:48:50.754135 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 07 08:48:50.754135 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 07 08:48:50.754135 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 07 08:48:50.754135 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 07 08:48:50.754135 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 07 08:48:50.754135 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 07 08:48:50.754135 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 44879a90-237c-4edf-8827-8f4a2ae7acdd is already attached to instances: 08308b76-0df7-4c43-a434-6880034a8c54 Jun 07 08:48:50.754135 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:48:50.754135 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:48:50.754135 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:48:50.754135 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:48:50.755423 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:48:50.755423 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:48:50.755423 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:48:50.755423 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:48:50.755423 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:48:50.755423 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:48:50.755423 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 08:48:50.755423 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 08:48:50.755423 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 08:48:50.755423 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 08:48:50.755423 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 07 08:48:50.755423 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 07 08:48:50.755423 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 07 08:48:50.755423 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 07 08:48:50.755423 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 44879a90-237c-4edf-8827-8f4a2ae7acdd is already attached to instances: 08308b76-0df7-4c43-a434-6880034a8c54 Jun 07 08:48:50.755423 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:48:50.755423 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:48:50.755423 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:48:50.755423 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:48:50.755423 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:48:50.757628 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:48:50.757628 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:48:50.757628 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:48:50.757628 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 44879a90-237c-4edf-8827-8f4a2ae7acdd is already attached to instances: 08308b76-0df7-4c43-a434-6880034a8c54 Jun 07 08:48:50.757628 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:48:50.757628 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-437ebf54-01c6-412e-885c-25b50c5b7a87 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Returning 400 to user: Invalid volume: volume 44879a90-237c-4edf-8827-8f4a2ae7acdd is already attached to instances: 08308b76-0df7-4c43-a434-6880034a8c54 {{(pid=129726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:48:50.757628 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-437ebf54-01c6-412e-885c-25b50c5b7a87 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "POST /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108732 Jun 07 08:48:50.758274 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 480/966] 10.222.0.17 () {60 vars in 1322 bytes} [Tue Jun 7 08:48:50 2022] POST /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 07 08:48:50.815124 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:48:50.819477 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-01eac1a2-1cd6-4c15-8cf0-404e2e94d57c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:48:50.826234 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-01eac1a2-1cd6-4c15-8cf0-404e2e94d57c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: 08308b76-0df7-4c43-a434-6880034a8c54] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:50.826877 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-01eac1a2-1cd6-4c15-8cf0-404e2e94d57c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:50.827355 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-01eac1a2-1cd6-4c15-8cf0-404e2e94d57c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:50.828126 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-01eac1a2-1cd6-4c15-8cf0-404e2e94d57c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:50.828564 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-01eac1a2-1cd6-4c15-8cf0-404e2e94d57c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:50.911534 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.objects.instance [None req-01eac1a2-1cd6-4c15-8cf0-404e2e94d57c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lazy-loading 'services' on Instance uuid 08308b76-0df7-4c43-a434-6880034a8c54 {{(pid=129725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:48:51.156440 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-01eac1a2-1cd6-4c15-8cf0-404e2e94d57c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "DELETE /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54/os-volume_attachments/44879a90-237c-4edf-8827-8f4a2ae7acdd" status: 202 len: 0 microversion: 2.1 time: 0.342654 Jun 07 08:48:51.156951 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 487/967] 10.222.0.17 () {58 vars in 1415 bytes} [Tue Jun 7 08:48:50 2022] DELETE /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54/os-volume_attachments/44879a90-237c-4edf-8827-8f4a2ae7acdd => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 08:48:51.166894 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-2ce1948a-361b-4bad-8d79-4530627c820b tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:48:51.167880 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-2ce1948a-361b-4bad-8d79-4530627c820b tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: 08308b76-0df7-4c43-a434-6880034a8c54] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:51.175663 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2ce1948a-361b-4bad-8d79-4530627c820b tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:51.176113 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2ce1948a-361b-4bad-8d79-4530627c820b tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:51.177294 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2ce1948a-361b-4bad-8d79-4530627c820b tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:51.177398 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2ce1948a-361b-4bad-8d79-4530627c820b tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:51.209055 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-2ce1948a-361b-4bad-8d79-4530627c820b tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047698 Jun 07 08:48:51.209766 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 481/968] 10.222.0.17 () {58 vars in 1301 bytes} [Tue Jun 7 08:48:51 2022] GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:48:52.221840 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-3442d604-0945-440b-9a1c-621bba7671a9 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:48:52.223002 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-3442d604-0945-440b-9a1c-621bba7671a9 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: 08308b76-0df7-4c43-a434-6880034a8c54] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:52.229509 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3442d604-0945-440b-9a1c-621bba7671a9 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:52.230016 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3442d604-0945-440b-9a1c-621bba7671a9 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:52.230776 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3442d604-0945-440b-9a1c-621bba7671a9 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:52.231226 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3442d604-0945-440b-9a1c-621bba7671a9 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:52.235133 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:48:52.262321 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-3442d604-0945-440b-9a1c-621bba7671a9 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045483 Jun 07 08:48:52.262909 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 488/969] 10.222.0.17 () {58 vars in 1301 bytes} [Tue Jun 7 08:48:52 2022] GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:48:53.273839 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-16dbb1d6-71ab-4fcf-b5c1-4be024240471 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:48:53.275370 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-16dbb1d6-71ab-4fcf-b5c1-4be024240471 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: 08308b76-0df7-4c43-a434-6880034a8c54] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:53.282432 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-16dbb1d6-71ab-4fcf-b5c1-4be024240471 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:53.282937 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-16dbb1d6-71ab-4fcf-b5c1-4be024240471 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:53.284068 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-16dbb1d6-71ab-4fcf-b5c1-4be024240471 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:53.284618 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-16dbb1d6-71ab-4fcf-b5c1-4be024240471 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:53.317158 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-16dbb1d6-71ab-4fcf-b5c1-4be024240471 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047405 Jun 07 08:48:53.317712 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 482/970] 10.222.0.17 () {58 vars in 1301 bytes} [Tue Jun 7 08:48:53 2022] GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 08:48:53.376902 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-34f94248-5c2b-43d7-bc36-23c0a9579c2d tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:48:53.377460 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-34f94248-5c2b-43d7-bc36-23c0a9579c2d tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: 08308b76-0df7-4c43-a434-6880034a8c54] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:53.384190 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-34f94248-5c2b-43d7-bc36-23c0a9579c2d tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:53.385180 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-34f94248-5c2b-43d7-bc36-23c0a9579c2d tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:53.386038 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-34f94248-5c2b-43d7-bc36-23c0a9579c2d tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:53.386549 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-34f94248-5c2b-43d7-bc36-23c0a9579c2d tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:53.413179 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-34f94248-5c2b-43d7-bc36-23c0a9579c2d tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: 08308b76-0df7-4c43-a434-6880034a8c54] Going to try to terminate instance {{(pid=129725) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 08:48:53.729609 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-34f94248-5c2b-43d7-bc36-23c0a9579c2d tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "DELETE /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54" status: 204 len: 0 microversion: 2.1 time: 0.356633 Jun 07 08:48:53.730271 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 489/971] 10.222.0.17 () {58 vars in 1238 bytes} [Tue Jun 7 08:48:53 2022] DELETE /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 08:48:53.739246 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-e295c4c8-da54-452a-9d55-b126eabb0a8a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:48:53.739896 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-e295c4c8-da54-452a-9d55-b126eabb0a8a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: 08308b76-0df7-4c43-a434-6880034a8c54] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:53.747474 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e295c4c8-da54-452a-9d55-b126eabb0a8a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:53.747919 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e295c4c8-da54-452a-9d55-b126eabb0a8a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:53.748687 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e295c4c8-da54-452a-9d55-b126eabb0a8a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:53.749141 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e295c4c8-da54-452a-9d55-b126eabb0a8a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:53.879980 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-e295c4c8-da54-452a-9d55-b126eabb0a8a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:48:53.888147 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-e295c4c8-da54-452a-9d55-b126eabb0a8a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54" status: 200 len: 1682 microversion: 2.1 time: 0.153491 Jun 07 08:48:53.888713 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 483/972] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:48:53 2022] GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:48:53.926517 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-ec6b1e2b-677c-426c-a10b-843a1f30f026 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:48:53.927130 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-ec6b1e2b-677c-426c-a10b-843a1f30f026 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: e234b6e6-1592-4038-acd2-8c1c60068dc9] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:53.934146 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ec6b1e2b-677c-426c-a10b-843a1f30f026 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:53.934596 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ec6b1e2b-677c-426c-a10b-843a1f30f026 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:53.935367 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ec6b1e2b-677c-426c-a10b-843a1f30f026 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:53.935807 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ec6b1e2b-677c-426c-a10b-843a1f30f026 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:54.020461 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.objects.instance [None req-ec6b1e2b-677c-426c-a10b-843a1f30f026 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lazy-loading 'services' on Instance uuid e234b6e6-1592-4038-acd2-8c1c60068dc9 {{(pid=129725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:48:54.260009 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-ec6b1e2b-677c-426c-a10b-843a1f30f026 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9/os-volume_attachments/3f3d6851-1391-4c51-b433-6155fd8c71a5" status: 202 len: 0 microversion: 2.1 time: 0.337505 Jun 07 08:48:54.260608 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 490/973] 10.222.0.17 () {58 vars in 1415 bytes} [Tue Jun 7 08:48:53 2022] DELETE /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9/os-volume_attachments/3f3d6851-1391-4c51-b433-6155fd8c71a5 => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 08:48:54.906621 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-1cc538be-2d8c-4406-b7db-e9472901f0db tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:48:54.907272 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-1cc538be-2d8c-4406-b7db-e9472901f0db tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: 08308b76-0df7-4c43-a434-6880034a8c54] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:54.913937 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1cc538be-2d8c-4406-b7db-e9472901f0db tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:54.914388 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1cc538be-2d8c-4406-b7db-e9472901f0db tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:54.915153 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1cc538be-2d8c-4406-b7db-e9472901f0db tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:54.915589 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1cc538be-2d8c-4406-b7db-e9472901f0db tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:55.054857 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-1cc538be-2d8c-4406-b7db-e9472901f0db tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:48:55.062553 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-1cc538be-2d8c-4406-b7db-e9472901f0db tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54" status: 200 len: 1682 microversion: 2.1 time: 0.160031 Jun 07 08:48:55.063117 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 484/974] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:48:54 2022] GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:48:56.085665 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-62fba653-e193-45c1-8ffe-d29eb8194360 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:48:56.086891 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-62fba653-e193-45c1-8ffe-d29eb8194360 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: 08308b76-0df7-4c43-a434-6880034a8c54] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:56.094445 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-62fba653-e193-45c1-8ffe-d29eb8194360 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:56.094900 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-62fba653-e193-45c1-8ffe-d29eb8194360 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:56.095674 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-62fba653-e193-45c1-8ffe-d29eb8194360 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:56.096120 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-62fba653-e193-45c1-8ffe-d29eb8194360 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:56.252625 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-62fba653-e193-45c1-8ffe-d29eb8194360 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:48:56.265372 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-62fba653-e193-45c1-8ffe-d29eb8194360 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54" status: 200 len: 1682 microversion: 2.1 time: 0.182141 Jun 07 08:48:56.265372 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 491/975] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:48:56 2022] GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54 => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:48:56.436603 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-8b357b2e-4b06-4c89-a009-07b6fe9aab58 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:48:56.437243 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-8b357b2e-4b06-4c89-a009-07b6fe9aab58 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: e234b6e6-1592-4038-acd2-8c1c60068dc9] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:56.443532 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8b357b2e-4b06-4c89-a009-07b6fe9aab58 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:56.443985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8b357b2e-4b06-4c89-a009-07b6fe9aab58 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:56.444748 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8b357b2e-4b06-4c89-a009-07b6fe9aab58 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:56.445216 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8b357b2e-4b06-4c89-a009-07b6fe9aab58 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:56.472432 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-8b357b2e-4b06-4c89-a009-07b6fe9aab58 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: e234b6e6-1592-4038-acd2-8c1c60068dc9] Going to try to terminate instance {{(pid=129726) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 08:48:56.634292 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-12aec4a3-951c-42ad-8be2-0d69ddd7283d req-67847b42-1f34-4483-87b0-9a7621dfb8eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08308b76-0df7-4c43-a434-6880034a8c54", "name": "network-vif-deleted", "tag": "f26913ff-23c8-416e-b118-034b1a42d415"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:48:56.643968 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-12aec4a3-951c-42ad-8be2-0d69ddd7283d req-67847b42-1f34-4483-87b0-9a7621dfb8eb service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:56.644760 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-12aec4a3-951c-42ad-8be2-0d69ddd7283d req-67847b42-1f34-4483-87b0-9a7621dfb8eb service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:56.657864 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-12aec4a3-951c-42ad-8be2-0d69ddd7283d req-67847b42-1f34-4483-87b0-9a7621dfb8eb service nova] Creating event network-vif-deleted:f26913ff-23c8-416e-b118-034b1a42d415 for instance 08308b76-0df7-4c43-a434-6880034a8c54 on hv-cinder-74014 Jun 07 08:48:56.664321 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-12aec4a3-951c-42ad-8be2-0d69ddd7283d req-67847b42-1f34-4483-87b0-9a7621dfb8eb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100863 Jun 07 08:48:56.666404 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 492/976] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:48:56.834024 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-8b357b2e-4b06-4c89-a009-07b6fe9aab58 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9" status: 204 len: 0 microversion: 2.1 time: 0.400775 Jun 07 08:48:56.834790 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 485/977] 10.222.0.17 () {58 vars in 1238 bytes} [Tue Jun 7 08:48:56 2022] DELETE /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 08:48:56.859678 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-6715cbe1-fe99-4bb9-9a7a-cc42ccffedaa tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:48:56.860396 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-6715cbe1-fe99-4bb9-9a7a-cc42ccffedaa tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: e234b6e6-1592-4038-acd2-8c1c60068dc9] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:56.867186 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6715cbe1-fe99-4bb9-9a7a-cc42ccffedaa tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:56.867641 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6715cbe1-fe99-4bb9-9a7a-cc42ccffedaa tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:56.868504 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6715cbe1-fe99-4bb9-9a7a-cc42ccffedaa tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:56.869445 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-6715cbe1-fe99-4bb9-9a7a-cc42ccffedaa tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:57.019237 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-6715cbe1-fe99-4bb9-9a7a-cc42ccffedaa tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c3d3030c6a4d42a941ae489c5bf125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287c3c3374034e3899d7c8b7d970a738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:48:57.027759 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-6715cbe1-fe99-4bb9-9a7a-cc42ccffedaa tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9" status: 200 len: 1513 microversion: 2.1 time: 0.173865 Jun 07 08:48:57.028480 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 493/978] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:48:56 2022] GET /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9 => generated 1513 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:48:57.281117 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-2806c552-91fa-40ae-9893-2196ca3c813f tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:48:57.281746 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-2806c552-91fa-40ae-9893-2196ca3c813f tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: 08308b76-0df7-4c43-a434-6880034a8c54] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:57.288264 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2806c552-91fa-40ae-9893-2196ca3c813f tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:57.288713 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2806c552-91fa-40ae-9893-2196ca3c813f tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:57.289525 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2806c552-91fa-40ae-9893-2196ca3c813f tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:57.289963 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2806c552-91fa-40ae-9893-2196ca3c813f tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:57.325821 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2806c552-91fa-40ae-9893-2196ca3c813f tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:57.326276 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2806c552-91fa-40ae-9893-2196ca3c813f tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:57.326785 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.objects.instance [None req-2806c552-91fa-40ae-9893-2196ca3c813f tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lazy-loading 'fault' on Instance uuid 08308b76-0df7-4c43-a434-6880034a8c54 {{(pid=129726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:48:57.379924 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-2806c552-91fa-40ae-9893-2196ca3c813f tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:48:57.388207 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-2806c552-91fa-40ae-9893-2196ca3c813f tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54" status: 200 len: 1331 microversion: 2.1 time: 0.114411 Jun 07 08:48:57.388816 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 486/979] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:48:57 2022] GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54 => generated 1331 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:48:58.044729 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-ac12b7c2-8722-498f-b2ec-b950dbf6c57f tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:48:58.045521 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-ac12b7c2-8722-498f-b2ec-b950dbf6c57f tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: e234b6e6-1592-4038-acd2-8c1c60068dc9] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:58.051739 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ac12b7c2-8722-498f-b2ec-b950dbf6c57f tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:58.052183 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ac12b7c2-8722-498f-b2ec-b950dbf6c57f tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:58.052941 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ac12b7c2-8722-498f-b2ec-b950dbf6c57f tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:58.053476 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ac12b7c2-8722-498f-b2ec-b950dbf6c57f tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:58.183220 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-ac12b7c2-8722-498f-b2ec-b950dbf6c57f tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c3d3030c6a4d42a941ae489c5bf125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287c3c3374034e3899d7c8b7d970a738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:48:58.190947 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-ac12b7c2-8722-498f-b2ec-b950dbf6c57f tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9" status: 200 len: 1513 microversion: 2.1 time: 0.149990 Jun 07 08:48:58.191580 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 494/980] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:48:58 2022] GET /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:48:58.406146 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-f445d5b8-31a1-45d8-bfe2-c6178f2c1293 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:48:58.406766 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-f445d5b8-31a1-45d8-bfe2-c6178f2c1293 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: 08308b76-0df7-4c43-a434-6880034a8c54] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:58.413484 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f445d5b8-31a1-45d8-bfe2-c6178f2c1293 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:58.417072 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f445d5b8-31a1-45d8-bfe2-c6178f2c1293 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:58.417072 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f445d5b8-31a1-45d8-bfe2-c6178f2c1293 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:58.417072 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f445d5b8-31a1-45d8-bfe2-c6178f2c1293 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:58.446733 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f445d5b8-31a1-45d8-bfe2-c6178f2c1293 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:58.447771 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f445d5b8-31a1-45d8-bfe2-c6178f2c1293 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:58.448225 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.objects.instance [None req-f445d5b8-31a1-45d8-bfe2-c6178f2c1293 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lazy-loading 'fault' on Instance uuid 08308b76-0df7-4c43-a434-6880034a8c54 {{(pid=129726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:48:58.488912 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-f445d5b8-31a1-45d8-bfe2-c6178f2c1293 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:48:58.497186 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-f445d5b8-31a1-45d8-bfe2-c6178f2c1293 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54" status: 200 len: 1331 microversion: 2.1 time: 0.094837 Jun 07 08:48:58.497754 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 487/981] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:48:58 2022] GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54 => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:48:59.208671 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-1bf39b97-e21b-4f08-9187-54669d4d90c5 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:48:59.212135 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-1bf39b97-e21b-4f08-9187-54669d4d90c5 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: e234b6e6-1592-4038-acd2-8c1c60068dc9] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:59.216006 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1bf39b97-e21b-4f08-9187-54669d4d90c5 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:59.216463 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1bf39b97-e21b-4f08-9187-54669d4d90c5 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:59.217266 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1bf39b97-e21b-4f08-9187-54669d4d90c5 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:59.217753 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-1bf39b97-e21b-4f08-9187-54669d4d90c5 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:59.312114 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-1bf39b97-e21b-4f08-9187-54669d4d90c5 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c3d3030c6a4d42a941ae489c5bf125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287c3c3374034e3899d7c8b7d970a738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:48:59.319706 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-1bf39b97-e21b-4f08-9187-54669d4d90c5 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9" status: 200 len: 1471 microversion: 2.1 time: 0.115029 Jun 07 08:48:59.320283 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 495/982] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:48:59 2022] GET /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9 => generated 1471 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:48:59.346309 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-e2444add-f77d-443b-abb9-cb9d72c303e2 req-2ace9252-fd5d-4ed9-9311-02d4a8368f0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e234b6e6-1592-4038-acd2-8c1c60068dc9", "name": "network-vif-deleted", "tag": "de18f595-5923-47e5-8b1f-6650f6a1d1e2"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:48:59.354709 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-e2444add-f77d-443b-abb9-cb9d72c303e2 req-2ace9252-fd5d-4ed9-9311-02d4a8368f0f service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:59.355165 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-e2444add-f77d-443b-abb9-cb9d72c303e2 req-2ace9252-fd5d-4ed9-9311-02d4a8368f0f service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:59.366782 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-e2444add-f77d-443b-abb9-cb9d72c303e2 req-2ace9252-fd5d-4ed9-9311-02d4a8368f0f service nova] Creating event network-vif-deleted:de18f595-5923-47e5-8b1f-6650f6a1d1e2 for instance e234b6e6-1592-4038-acd2-8c1c60068dc9 on hv-cinder-74014 Jun 07 08:48:59.372361 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-e2444add-f77d-443b-abb9-cb9d72c303e2 req-2ace9252-fd5d-4ed9-9311-02d4a8368f0f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029729 Jun 07 08:48:59.373051 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 488/983] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:48:59.519649 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-a741cf7d-589c-44dc-82c7-ee67782dd3de tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:48:59.520201 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-a741cf7d-589c-44dc-82c7-ee67782dd3de tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: 08308b76-0df7-4c43-a434-6880034a8c54] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:48:59.526839 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a741cf7d-589c-44dc-82c7-ee67782dd3de tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:59.529230 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a741cf7d-589c-44dc-82c7-ee67782dd3de tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:59.529230 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a741cf7d-589c-44dc-82c7-ee67782dd3de tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:48:59.529230 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a741cf7d-589c-44dc-82c7-ee67782dd3de tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:48:59.544552 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.wsgi [None req-a741cf7d-589c-44dc-82c7-ee67782dd3de tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] HTTP exception thrown: Instance 08308b76-0df7-4c43-a434-6880034a8c54 could not be found. Jun 07 08:48:59.546535 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-a741cf7d-589c-44dc-82c7-ee67782dd3de tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Request method failure captured: Jun 07 08:48:59.546535 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: request: GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54 HTTP/1.1 Jun 07 08:48:59.546535 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept: application/json Jun 07 08:48:59.546535 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept-Encoding: identity Jun 07 08:48:59.546535 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Connection: close Jun 07 08:48:59.546535 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Length: 0 Jun 07 08:48:59.546535 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Type: application/json Jun 07 08:48:59.546535 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Host: 10.222.0.17 Jun 07 08:48:59.546535 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Openstack-System-Scope: None Jun 07 08:48:59.546535 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: User-Agent: python-urllib3/1.26.9 Jun 07 08:48:59.546535 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Auth-Token: gAAAAABinxAgj5C7ouE1N-aaB4GYPlt92HgnY7l_4qNjeb7MhcXewkqTDq3SwhJjBOupqPwAwi-EUO3Doxu5eOmMdEwFCWQlkuqeuPwgDsRWAIP7QSDJjzl4qrePMCoCSyDT0Sg0QJjM04PVEJfbaffcjJA3z-4CjpQwrMDzvrui6SNaABiQiRQ Jun 07 08:48:59.546535 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Id: None Jun 07 08:48:59.546535 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Name: None Jun 07 08:48:59.546535 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Identity-Status: Confirmed Jun 07 08:48:59.546535 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Is-Admin-Project: True Jun 07 08:48:59.546535 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Id: default Jun 07 08:48:59.546535 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Name: Default Jun 07 08:48:59.546535 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Id: 0899cad1b7c64a0199b3466d4c7cfefb Jun 07 08:48:59.546535 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Name: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:48:59.546535 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Role: reader,member Jun 07 08:48:59.546535 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Roles: reader,member Jun 07 08:48:59.554684 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0899cad1b7c64a0199b3466d4c7cfefb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0899cad1b7c64a0199b3466d4c7cfefb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0899cad1b7c64a0199b3466d4c7cfefb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0899cad1b7c64a0199b3466d4c7cfefb"}]}] Jun 07 08:48:59.554684 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:48:59.554684 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Id: 0899cad1b7c64a0199b3466d4c7cfefb Jun 07 08:48:59.554684 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:48:59.554684 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User: tempest-AttachVolumeNegativeTest-1278776647-project Jun 07 08:48:59.554684 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Id: default Jun 07 08:48:59.554684 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Name: Default Jun 07 08:48:59.554684 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Id: 52ddf59fe764404eb1c6ee745e21d352 Jun 07 08:48:59.554684 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Name: tempest-AttachVolumeNegativeTest-1278776647-project Jun 07 08:48:59.554684 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: method: > Jun 07 08:48:59.554684 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: exception: Instance 08308b76-0df7-4c43-a434-6880034a8c54 could not be found. Jun 07 08:48:59.554684 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: action_args: {'id': '08308b76-0df7-4c43-a434-6880034a8c54'} Jun 07 08:48:59.555651 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:48:59.555651 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:48:59.555651 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:48:59.555651 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:48:59.555651 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:48:59.555651 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:48:59.555651 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:48:59.555651 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:48:59.555651 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:48:59.555651 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:48:59.555651 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08308b76-0df7-4c43-a434-6880034a8c54 could not be found. Jun 07 08:48:59.555651 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:48:59.555651 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:48:59.555651 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:48:59.555651 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:48:59.555651 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:48:59.555651 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:48:59.555651 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:48:59.555651 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:48:59.555651 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:48:59.557907 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:48:59.557907 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 08:48:59.557907 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 08:48:59.557907 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:48:59.557907 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:48:59.557907 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:48:59.557907 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:48:59.557907 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08308b76-0df7-4c43-a434-6880034a8c54 could not be found. Jun 07 08:48:59.557907 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:48:59.557907 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:48:59.557907 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:48:59.557907 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:48:59.557907 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:48:59.557907 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:48:59.557907 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:48:59.557907 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:48:59.557907 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08308b76-0df7-4c43-a434-6880034a8c54 could not be found. Jun 07 08:48:59.557907 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:48:59.559313 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-a741cf7d-589c-44dc-82c7-ee67782dd3de tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Returning 404 to user: Instance 08308b76-0df7-4c43-a434-6880034a8c54 could not be found. {{(pid=129725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:48:59.559313 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-a741cf7d-589c-44dc-82c7-ee67782dd3de tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54" status: 404 len: 111 microversion: 2.1 time: 0.037901 Jun 07 08:48:59.559313 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 496/984] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:48:59 2022] GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:48:59.566194 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-ec47e8ff-d856-4f1f-8afa-aa4cae1a2e9c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '.version_select at 0x7f7fecc36670>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:48:59.655935 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-ec47e8ff-d856-4f1f-8afa-aa4cae1a2e9c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-645177096" status: 202 len: 0 microversion: 2.1 time: 0.102696 Jun 07 08:48:59.656527 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 489/985] 10.222.0.17 () {58 vars in 1217 bytes} [Tue Jun 7 08:48:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-645177096 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 08:49:00.336359 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-69d6b644-d638-4011-9982-98e147ee49c1 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:49:00.340083 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-69d6b644-d638-4011-9982-98e147ee49c1 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: e234b6e6-1592-4038-acd2-8c1c60068dc9] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:49:00.344263 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-69d6b644-d638-4011-9982-98e147ee49c1 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:00.344717 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-69d6b644-d638-4011-9982-98e147ee49c1 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:00.345529 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-69d6b644-d638-4011-9982-98e147ee49c1 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:00.345971 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-69d6b644-d638-4011-9982-98e147ee49c1 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:00.380750 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-69d6b644-d638-4011-9982-98e147ee49c1 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:00.381237 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-69d6b644-d638-4011-9982-98e147ee49c1 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:00.381699 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.objects.instance [None req-69d6b644-d638-4011-9982-98e147ee49c1 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lazy-loading 'fault' on Instance uuid e234b6e6-1592-4038-acd2-8c1c60068dc9 {{(pid=129725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:49:00.385922 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-598df390-b73b-411c-a04b-58a74b385678 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Action: 'create', calling method: .version_select at 0x7f7fecad31f0>, body: {"keypair": {"name": "tempest-keypair-1740331994", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDd7owpz+Cwb7rDH244WYaOQn9Ya1hWKbFIki0dSAeXBJkrDrkSJAtX/C7nDjsz/pRd/bFSAollJck+8UoL0Ds8/GeVWfMu2JozTzxKWWXw23uyZRFXb9ROgt2UFstKmlg=="}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:49:00.404370 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-598df390-b73b-411c-a04b-58a74b385678 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Getting quotas for project 0899cad1b7c64a0199b3466d4c7cfefb. Resources: {'key_pairs'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 08:49:00.408464 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-598df390-b73b-411c-a04b-58a74b385678 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Getting quotas for user 52ddf59fe764404eb1c6ee745e21d352 and project 0899cad1b7c64a0199b3466d4c7cfefb. Resources: {'key_pairs'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 08:49:00.426963 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-69d6b644-d638-4011-9982-98e147ee49c1 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03c3d3030c6a4d42a941ae489c5bf125', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '287c3c3374034e3899d7c8b7d970a738', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:49:00.433789 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-69d6b644-d638-4011-9982-98e147ee49c1 tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9" status: 200 len: 1309 microversion: 2.1 time: 0.101286 Jun 07 08:49:00.434355 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 497/986] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:49:00 2022] GET /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9 => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:49:00.490085 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-598df390-b73b-411c-a04b-58a74b385678 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.108572 Jun 07 08:49:00.490689 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 490/987] 10.222.0.17 () {60 vars in 1158 bytes} [Tue Jun 7 08:49:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:49:01.453648 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-4f5c579e-7770-433f-8df1-f7bf7f8e2bef tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:49:01.454373 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-4f5c579e-7770-433f-8df1-f7bf7f8e2bef tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] [instance: e234b6e6-1592-4038-acd2-8c1c60068dc9] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:49:01.463148 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4f5c579e-7770-433f-8df1-f7bf7f8e2bef tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:01.463148 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4f5c579e-7770-433f-8df1-f7bf7f8e2bef tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:01.463148 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4f5c579e-7770-433f-8df1-f7bf7f8e2bef tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:01.463148 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4f5c579e-7770-433f-8df1-f7bf7f8e2bef tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:01.477121 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.wsgi [None req-4f5c579e-7770-433f-8df1-f7bf7f8e2bef tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] HTTP exception thrown: Instance e234b6e6-1592-4038-acd2-8c1c60068dc9 could not be found. Jun 07 08:49:01.478819 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-4f5c579e-7770-433f-8df1-f7bf7f8e2bef tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Request method failure captured: Jun 07 08:49:01.478819 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: request: GET /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9 HTTP/1.1 Jun 07 08:49:01.478819 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept: application/json Jun 07 08:49:01.478819 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept-Encoding: identity Jun 07 08:49:01.478819 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Connection: close Jun 07 08:49:01.478819 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Length: 0 Jun 07 08:49:01.478819 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Type: application/json Jun 07 08:49:01.478819 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Host: 10.222.0.17 Jun 07 08:49:01.478819 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Openstack-System-Scope: None Jun 07 08:49:01.478819 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: User-Agent: python-urllib3/1.26.9 Jun 07 08:49:01.478819 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Auth-Token: gAAAAABinxCJ2balZJT7kf6PtUgC-06MPqCZUFGn-Ts2ZTd1Qh6vW5svO-fHHUFzqo9wNfALk0FdiJciDamDNuTFV52Jq1Mv8jvy8wjgyshRUyvKHjNowUFN4fFp324I9041_j4tKcpbmmwxoQoW0IldaWS1iny5Wyt3Ru9FYs9KY-A-1zx4PkI Jun 07 08:49:01.478819 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Id: None Jun 07 08:49:01.478819 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Name: None Jun 07 08:49:01.478819 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Identity-Status: Confirmed Jun 07 08:49:01.478819 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Is-Admin-Project: True Jun 07 08:49:01.478819 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Id: default Jun 07 08:49:01.478819 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Name: Default Jun 07 08:49:01.478819 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Id: 287c3c3374034e3899d7c8b7d970a738 Jun 07 08:49:01.478819 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Name: tempest-VolumesSnapshotTestJSON-586971830 Jun 07 08:49:01.478819 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Role: reader,member Jun 07 08:49:01.478819 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Roles: reader,member Jun 07 08:49:01.480516 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/287c3c3374034e3899d7c8b7d970a738"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/287c3c3374034e3899d7c8b7d970a738"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_287c3c3374034e3899d7c8b7d970a738", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/287c3c3374034e3899d7c8b7d970a738"}]}] Jun 07 08:49:01.480516 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant: tempest-VolumesSnapshotTestJSON-586971830 Jun 07 08:49:01.480516 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Id: 287c3c3374034e3899d7c8b7d970a738 Jun 07 08:49:01.480516 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-586971830 Jun 07 08:49:01.480516 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User: tempest-VolumesSnapshotTestJSON-586971830-project Jun 07 08:49:01.480516 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Id: default Jun 07 08:49:01.480516 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Name: Default Jun 07 08:49:01.480516 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Id: 03c3d3030c6a4d42a941ae489c5bf125 Jun 07 08:49:01.480516 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Name: tempest-VolumesSnapshotTestJSON-586971830-project Jun 07 08:49:01.480516 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: method: > Jun 07 08:49:01.480516 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: exception: Instance e234b6e6-1592-4038-acd2-8c1c60068dc9 could not be found. Jun 07 08:49:01.480516 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: action_args: {'id': 'e234b6e6-1592-4038-acd2-8c1c60068dc9'} Jun 07 08:49:01.481640 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:49:01.481640 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:49:01.481640 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:49:01.481640 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:49:01.481640 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:49:01.481640 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:49:01.481640 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:49:01.481640 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:49:01.481640 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:49:01.481640 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:49:01.481640 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e234b6e6-1592-4038-acd2-8c1c60068dc9 could not be found. Jun 07 08:49:01.481640 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:49:01.481640 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:49:01.481640 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:49:01.481640 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:49:01.481640 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:49:01.481640 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:49:01.481640 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:49:01.481640 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:49:01.481640 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:49:01.483196 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:49:01.483196 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 08:49:01.483196 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 08:49:01.483196 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:49:01.483196 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:49:01.483196 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:49:01.483196 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:49:01.483196 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e234b6e6-1592-4038-acd2-8c1c60068dc9 could not be found. Jun 07 08:49:01.483196 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:49:01.483196 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:49:01.483196 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:49:01.483196 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:49:01.483196 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:49:01.483196 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:49:01.483196 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:49:01.483196 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:49:01.483196 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e234b6e6-1592-4038-acd2-8c1c60068dc9 could not be found. Jun 07 08:49:01.483196 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:49:01.484764 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-4f5c579e-7770-433f-8df1-f7bf7f8e2bef tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] Returning 404 to user: Instance e234b6e6-1592-4038-acd2-8c1c60068dc9 could not be found. {{(pid=129725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:49:01.484764 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-4f5c579e-7770-433f-8df1-f7bf7f8e2bef tempest-VolumesSnapshotTestJSON-586971830 tempest-VolumesSnapshotTestJSON-586971830-project] 10.222.0.17 "GET /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9" status: 404 len: 111 microversion: 2.1 time: 0.031098 Jun 07 08:49:01.484764 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 498/988] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:49:01 2022] GET /compute/v2.1/servers/e234b6e6-1592-4038-acd2-8c1c60068dc9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:49:02.891510 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-ff424f47-81f5-46f1-a484-51b017fafbf2 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1935534499", "imageRef": "c04b0a92-7675-47c3-bcc2-8a2a59b997c3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "887f6fc8-6e65-421d-990a-570b64e04d42"}], "security_groups": [{"name": "tempest-securitygroup--713291698"}], "key_name": "tempest-keypair-1740331994", "user_data": "}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:49:02.994137 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.network.neutron [None req-ff424f47-81f5-46f1-a484-51b017fafbf2 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] validate_networks() for [('887f6fc8-6e65-421d-990a-570b64e04d42', None, None, None, None, None)] {{(pid=129726) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 08:49:03.389527 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-ff424f47-81f5-46f1-a484-51b017fafbf2 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Flavor limits 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 08:49:03.394811 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-ff424f47-81f5-46f1-a484-51b017fafbf2 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Image limits 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 08:49:03.394811 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-ff424f47-81f5-46f1-a484-51b017fafbf2 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Flavor pref 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 08:49:03.394811 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-ff424f47-81f5-46f1-a484-51b017fafbf2 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Image pref 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 08:49:03.394811 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-ff424f47-81f5-46f1-a484-51b017fafbf2 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 08:49:03.407927 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ff424f47-81f5-46f1-a484-51b017fafbf2 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:03.408592 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ff424f47-81f5-46f1-a484-51b017fafbf2 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:03.409453 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ff424f47-81f5-46f1-a484-51b017fafbf2 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:03.409926 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ff424f47-81f5-46f1-a484-51b017fafbf2 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:03.428988 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-ff424f47-81f5-46f1-a484-51b017fafbf2 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Getting quotas for project 0899cad1b7c64a0199b3466d4c7cfefb. Resources: {'ram', 'cores', 'instances'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 08:49:03.433451 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-ff424f47-81f5-46f1-a484-51b017fafbf2 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Getting quotas for user 52ddf59fe764404eb1c6ee745e21d352 and project 0899cad1b7c64a0199b3466d4c7cfefb. Resources: {'ram', 'cores', 'instances'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 08:49:03.446815 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-ff424f47-81f5-46f1-a484-51b017fafbf2 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Going to run 1 instances... {{(pid=129726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 08:49:03.449817 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-ff424f47-81f5-46f1-a484-51b017fafbf2 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: aec994fe-285c-4222-868f-d7b8f1e9e8b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c04b0a92-7675-47c3-bcc2-8a2a59b997c3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 08:49:03.610167 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-ff424f47-81f5-46f1-a484-51b017fafbf2 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.723329 Jun 07 08:49:03.610859 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 491/989] 10.222.0.17 () {60 vars in 1146 bytes} [Tue Jun 7 08:49:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 08:49:03.622466 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-070b7480-40a3-4c92-86da-de67879062df tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:49:03.623220 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-070b7480-40a3-4c92-86da-de67879062df tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: aec994fe-285c-4222-868f-d7b8f1e9e8b5] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:49:03.705060 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-070b7480-40a3-4c92-86da-de67879062df tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:49:03.711953 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-070b7480-40a3-4c92-86da-de67879062df tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5" status: 200 len: 1242 microversion: 2.1 time: 0.095006 Jun 07 08:49:03.713041 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 499/990] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:49:03 2022] GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5 => generated 1242 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:49:04.069669 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-bdfe87de-4bdb-44b4-acf7-4470fb02421e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:49:04.070216 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-bdfe87de-4bdb-44b4-acf7-4470fb02421e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:49:04.073655 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-157d1a6e-9ced-4795-9ba7-3cbb0c7af442 req-dc8028c9-3554-4f51-9885-f4f1cd274d40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb70e18b-43bf-402d-9d70-028908bfc7fd", "tag": "c5b234fe-05ce-4bf2-a2ef-1e4c55770be9"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:49:04.077759 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-bdfe87de-4bdb-44b4-acf7-4470fb02421e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:04.078203 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-bdfe87de-4bdb-44b4-acf7-4470fb02421e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:04.079186 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-bdfe87de-4bdb-44b4-acf7-4470fb02421e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:04.079622 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-bdfe87de-4bdb-44b4-acf7-4470fb02421e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:04.084208 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-157d1a6e-9ced-4795-9ba7-3cbb0c7af442 req-dc8028c9-3554-4f51-9885-f4f1cd274d40 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:04.086275 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-157d1a6e-9ced-4795-9ba7-3cbb0c7af442 req-dc8028c9-3554-4f51-9885-f4f1cd274d40 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:04.096452 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-157d1a6e-9ced-4795-9ba7-3cbb0c7af442 req-dc8028c9-3554-4f51-9885-f4f1cd274d40 service nova] Creating event network-changed:c5b234fe-05ce-4bf2-a2ef-1e4c55770be9 for instance cb70e18b-43bf-402d-9d70-028908bfc7fd on hv-cinder-74014 Jun 07 08:49:04.101724 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-157d1a6e-9ced-4795-9ba7-3cbb0c7af442 req-dc8028c9-3554-4f51-9885-f4f1cd274d40 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033280 Jun 07 08:49:04.102320 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 500/991] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:49:04.111617 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-bdfe87de-4bdb-44b4-acf7-4470fb02421e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Going to try to terminate instance {{(pid=129726) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 08:49:04.384967 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-bdfe87de-4bdb-44b4-acf7-4470fb02421e tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 204 len: 0 microversion: 2.1 time: 0.319035 Jun 07 08:49:04.385590 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 492/992] 10.222.0.17 () {58 vars in 1238 bytes} [Tue Jun 7 08:49:04 2022] DELETE /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 08:49:04.395000 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-495b58e8-97a3-4a5f-a54a-f46c2f4a4303 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:49:04.395754 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-495b58e8-97a3-4a5f-a54a-f46c2f4a4303 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:49:04.402404 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-495b58e8-97a3-4a5f-a54a-f46c2f4a4303 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:04.402889 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-495b58e8-97a3-4a5f-a54a-f46c2f4a4303 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:04.403664 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-495b58e8-97a3-4a5f-a54a-f46c2f4a4303 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:04.404126 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-495b58e8-97a3-4a5f-a54a-f46c2f4a4303 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:04.545175 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-495b58e8-97a3-4a5f-a54a-f46c2f4a4303 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:49:04.552733 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-495b58e8-97a3-4a5f-a54a-f46c2f4a4303 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1569 microversion: 2.1 time: 0.162102 Jun 07 08:49:04.553323 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 501/993] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:49:04 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:49:04.731895 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-9321ca56-1e7e-4a59-a6cf-7316a7f75096 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:49:04.732986 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-9321ca56-1e7e-4a59-a6cf-7316a7f75096 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: aec994fe-285c-4222-868f-d7b8f1e9e8b5] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:49:04.740975 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9321ca56-1e7e-4a59-a6cf-7316a7f75096 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:04.741686 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9321ca56-1e7e-4a59-a6cf-7316a7f75096 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:04.742451 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9321ca56-1e7e-4a59-a6cf-7316a7f75096 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:04.742939 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-9321ca56-1e7e-4a59-a6cf-7316a7f75096 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:04.806103 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-9321ca56-1e7e-4a59-a6cf-7316a7f75096 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:49:04.813752 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-9321ca56-1e7e-4a59-a6cf-7316a7f75096 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5" status: 200 len: 1246 microversion: 2.1 time: 0.088216 Jun 07 08:49:04.814537 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 493/994] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:49:04 2022] GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:49:05.571429 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-ce60721a-8948-4a6c-9cc4-f8bb490521ef tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:49:05.572043 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-ce60721a-8948-4a6c-9cc4-f8bb490521ef tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:49:05.578973 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ce60721a-8948-4a6c-9cc4-f8bb490521ef tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:05.579423 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ce60721a-8948-4a6c-9cc4-f8bb490521ef tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:05.580181 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ce60721a-8948-4a6c-9cc4-f8bb490521ef tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:05.580617 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ce60721a-8948-4a6c-9cc4-f8bb490521ef tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:05.708379 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-ce60721a-8948-4a6c-9cc4-f8bb490521ef tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:49:05.717075 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-ce60721a-8948-4a6c-9cc4-f8bb490521ef tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1569 microversion: 2.1 time: 0.149135 Jun 07 08:49:05.717649 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 502/995] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:49:05 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:49:05.830544 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-0059de4b-2f4e-4c47-9f42-0047aba9ee1a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:49:05.831067 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-0059de4b-2f4e-4c47-9f42-0047aba9ee1a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: aec994fe-285c-4222-868f-d7b8f1e9e8b5] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:49:05.837547 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0059de4b-2f4e-4c47-9f42-0047aba9ee1a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:05.837991 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0059de4b-2f4e-4c47-9f42-0047aba9ee1a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:05.838738 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0059de4b-2f4e-4c47-9f42-0047aba9ee1a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:05.839174 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0059de4b-2f4e-4c47-9f42-0047aba9ee1a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:05.899106 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-0059de4b-2f4e-4c47-9f42-0047aba9ee1a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:49:05.907264 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-0059de4b-2f4e-4c47-9f42-0047aba9ee1a tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5" status: 200 len: 1246 microversion: 2.1 time: 0.080578 Jun 07 08:49:05.907826 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 494/996] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:49:05 2022] GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5 => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:49:06.734629 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-868af514-260c-40de-a7b9-69ee94058275 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:49:06.735149 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-868af514-260c-40de-a7b9-69ee94058275 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:49:06.741691 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-868af514-260c-40de-a7b9-69ee94058275 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:06.742178 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-868af514-260c-40de-a7b9-69ee94058275 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:06.742932 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-868af514-260c-40de-a7b9-69ee94058275 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:06.743365 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-868af514-260c-40de-a7b9-69ee94058275 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:06.874162 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-868af514-260c-40de-a7b9-69ee94058275 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:49:06.881651 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-868af514-260c-40de-a7b9-69ee94058275 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1569 microversion: 2.1 time: 0.151225 Jun 07 08:49:06.882236 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 503/997] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:49:06 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:49:06.924332 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-c0a934cd-ecd7-4733-8ee6-c6acec1ee193 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:49:06.925025 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-c0a934cd-ecd7-4733-8ee6-c6acec1ee193 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: aec994fe-285c-4222-868f-d7b8f1e9e8b5] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:49:06.931491 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c0a934cd-ecd7-4733-8ee6-c6acec1ee193 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:06.932004 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c0a934cd-ecd7-4733-8ee6-c6acec1ee193 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:06.932746 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c0a934cd-ecd7-4733-8ee6-c6acec1ee193 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:06.933892 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c0a934cd-ecd7-4733-8ee6-c6acec1ee193 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:06.993523 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-c0a934cd-ecd7-4733-8ee6-c6acec1ee193 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:49:06.997973 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:49:07.002214 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-c0a934cd-ecd7-4733-8ee6-c6acec1ee193 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5" status: 200 len: 1246 microversion: 2.1 time: 0.081989 Jun 07 08:49:07.002782 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 495/998] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:49:06 2022] GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:49:08.003418 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-5adfc969-0703-4241-b796-5b04ffd82714 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:49:08.004150 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-5adfc969-0703-4241-b796-5b04ffd82714 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:49:08.013545 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5adfc969-0703-4241-b796-5b04ffd82714 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:08.018471 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5adfc969-0703-4241-b796-5b04ffd82714 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:08.019277 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5adfc969-0703-4241-b796-5b04ffd82714 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:08.019715 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5adfc969-0703-4241-b796-5b04ffd82714 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:08.019979 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-377732e9-1cff-4a90-b8d5-482eb51da446 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:49:08.020674 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-377732e9-1cff-4a90-b8d5-482eb51da446 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: aec994fe-285c-4222-868f-d7b8f1e9e8b5] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:49:08.037233 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-377732e9-1cff-4a90-b8d5-482eb51da446 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:08.037949 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-377732e9-1cff-4a90-b8d5-482eb51da446 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:08.038756 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-377732e9-1cff-4a90-b8d5-482eb51da446 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:08.039174 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-377732e9-1cff-4a90-b8d5-482eb51da446 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:08.115474 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-377732e9-1cff-4a90-b8d5-482eb51da446 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:49:08.124037 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-377732e9-1cff-4a90-b8d5-482eb51da446 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5" status: 200 len: 1238 microversion: 2.1 time: 0.108121 Jun 07 08:49:08.125114 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 496/999] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:49:08 2022] GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5 => generated 1238 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:49:08.242017 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-5adfc969-0703-4241-b796-5b04ffd82714 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:49:08.251475 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-5adfc969-0703-4241-b796-5b04ffd82714 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1569 microversion: 2.1 time: 0.357095 Jun 07 08:49:08.252307 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 504/1000] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:49:07 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1569 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:49:09.147468 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-85677042-9531-495f-8749-d494c3313432 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:49:09.148126 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-85677042-9531-495f-8749-d494c3313432 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: aec994fe-285c-4222-868f-d7b8f1e9e8b5] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:49:09.155876 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-85677042-9531-495f-8749-d494c3313432 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:09.156333 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-85677042-9531-495f-8749-d494c3313432 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:09.157205 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-85677042-9531-495f-8749-d494c3313432 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:09.157566 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-85677042-9531-495f-8749-d494c3313432 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:09.224963 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-85677042-9531-495f-8749-d494c3313432 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:49:09.238541 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-665cf975-1fb8-4162-9fed-82f77b524333 req-6879e42d-c40f-41eb-aa88-b14aaacb7dab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb70e18b-43bf-402d-9d70-028908bfc7fd", "name": "network-vif-deleted", "tag": "c5b234fe-05ce-4bf2-a2ef-1e4c55770be9"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:49:09.243880 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-85677042-9531-495f-8749-d494c3313432 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5" status: 200 len: 1300 microversion: 2.1 time: 0.090068 Jun 07 08:49:09.244817 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 497/1001] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:49:09 2022] GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5 => generated 1300 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:49:09.247631 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-665cf975-1fb8-4162-9fed-82f77b524333 req-6879e42d-c40f-41eb-aa88-b14aaacb7dab service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:09.248080 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-665cf975-1fb8-4162-9fed-82f77b524333 req-6879e42d-c40f-41eb-aa88-b14aaacb7dab service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:09.268439 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-665cf975-1fb8-4162-9fed-82f77b524333 req-6879e42d-c40f-41eb-aa88-b14aaacb7dab service nova] Creating event network-vif-deleted:c5b234fe-05ce-4bf2-a2ef-1e4c55770be9 for instance cb70e18b-43bf-402d-9d70-028908bfc7fd on hv-cinder-74014 Jun 07 08:49:09.269650 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-e5956b0a-ca82-41c9-a3e3-c9a5af2e39d2 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:49:09.270368 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-e5956b0a-ca82-41c9-a3e3-c9a5af2e39d2 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:49:09.272818 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-665cf975-1fb8-4162-9fed-82f77b524333 req-6879e42d-c40f-41eb-aa88-b14aaacb7dab service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037801 Jun 07 08:49:09.273821 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 505/1002] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:49:09.279656 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e5956b0a-ca82-41c9-a3e3-c9a5af2e39d2 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:09.280274 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e5956b0a-ca82-41c9-a3e3-c9a5af2e39d2 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:09.281120 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e5956b0a-ca82-41c9-a3e3-c9a5af2e39d2 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:09.281643 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-e5956b0a-ca82-41c9-a3e3-c9a5af2e39d2 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:09.349687 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-e5956b0a-ca82-41c9-a3e3-c9a5af2e39d2 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:49:09.359546 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-e5956b0a-ca82-41c9-a3e3-c9a5af2e39d2 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1383 microversion: 2.1 time: 0.094675 Jun 07 08:49:09.360128 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 498/1003] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:49:09 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1383 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:49:10.264417 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-ef11ba04-c531-4264-8e6a-2fe129bde056 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:49:10.265270 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-ef11ba04-c531-4264-8e6a-2fe129bde056 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: aec994fe-285c-4222-868f-d7b8f1e9e8b5] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:49:10.273594 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ef11ba04-c531-4264-8e6a-2fe129bde056 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:10.273992 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ef11ba04-c531-4264-8e6a-2fe129bde056 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:10.274942 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ef11ba04-c531-4264-8e6a-2fe129bde056 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:10.275397 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ef11ba04-c531-4264-8e6a-2fe129bde056 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:10.291991 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:49:10.376479 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-56363da2-b8e0-46ae-bb61-8f3e53a5b1f8 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:49:10.377418 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-56363da2-b8e0-46ae-bb61-8f3e53a5b1f8 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:49:10.384179 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-56363da2-b8e0-46ae-bb61-8f3e53a5b1f8 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:10.384633 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-56363da2-b8e0-46ae-bb61-8f3e53a5b1f8 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:10.385558 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-56363da2-b8e0-46ae-bb61-8f3e53a5b1f8 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:10.386002 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-56363da2-b8e0-46ae-bb61-8f3e53a5b1f8 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:10.419035 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-56363da2-b8e0-46ae-bb61-8f3e53a5b1f8 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:10.419487 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-56363da2-b8e0-46ae-bb61-8f3e53a5b1f8 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:10.419944 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.objects.instance [None req-56363da2-b8e0-46ae-bb61-8f3e53a5b1f8 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lazy-loading 'fault' on Instance uuid cb70e18b-43bf-402d-9d70-028908bfc7fd {{(pid=129726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:49:10.462541 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-56363da2-b8e0-46ae-bb61-8f3e53a5b1f8 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346ec431db3947ea97f1f2e3b27db0a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfc85651f1d947e3b52f02b4cf8e26b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:49:10.475601 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-56363da2-b8e0-46ae-bb61-8f3e53a5b1f8 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 200 len: 1225 microversion: 2.1 time: 0.099447 Jun 07 08:49:10.475724 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-ef11ba04-c531-4264-8e6a-2fe129bde056 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:49:10.475842 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 499/1004] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:49:10 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:49:10.483099 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-ef11ba04-c531-4264-8e6a-2fe129bde056 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5" status: 200 len: 1367 microversion: 2.1 time: 0.224989 Jun 07 08:49:10.484005 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 506/1005] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:49:10 2022] GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:49:11.304142 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-3aafaaaa-4cf6-42ae-9332-fd66cf434ad2 req-2f52f68a-a28a-4abe-9b7d-ecac8625843e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aec994fe-285c-4222-868f-d7b8f1e9e8b5", "tag": "f71f2a85-4cbe-4f0e-b841-67afab91baf3"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:49:11.312921 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-3aafaaaa-4cf6-42ae-9332-fd66cf434ad2 req-2f52f68a-a28a-4abe-9b7d-ecac8625843e service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:11.313467 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-3aafaaaa-4cf6-42ae-9332-fd66cf434ad2 req-2f52f68a-a28a-4abe-9b7d-ecac8625843e service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:11.327235 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-3aafaaaa-4cf6-42ae-9332-fd66cf434ad2 req-2f52f68a-a28a-4abe-9b7d-ecac8625843e service nova] Creating event network-changed:f71f2a85-4cbe-4f0e-b841-67afab91baf3 for instance aec994fe-285c-4222-868f-d7b8f1e9e8b5 on hv-cinder-74014 Jun 07 08:49:11.332354 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-3aafaaaa-4cf6-42ae-9332-fd66cf434ad2 req-2f52f68a-a28a-4abe-9b7d-ecac8625843e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037148 Jun 07 08:49:11.333494 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 500/1006] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:49:11.490426 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-359b1736-f655-4019-9c0d-0159349ea015 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:49:11.491164 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-359b1736-f655-4019-9c0d-0159349ea015 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] [instance: cb70e18b-43bf-402d-9d70-028908bfc7fd] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:49:11.499447 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-359b1736-f655-4019-9c0d-0159349ea015 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:11.499993 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-359b1736-f655-4019-9c0d-0159349ea015 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:11.500850 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-359b1736-f655-4019-9c0d-0159349ea015 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:11.501506 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-359b1736-f655-4019-9c0d-0159349ea015 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:11.502678 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-a89f33ef-42c6-4f47-b7af-9e2d6f2e339e tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:49:11.503507 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-a89f33ef-42c6-4f47-b7af-9e2d6f2e339e tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: aec994fe-285c-4222-868f-d7b8f1e9e8b5] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:49:11.511510 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a89f33ef-42c6-4f47-b7af-9e2d6f2e339e tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:11.512025 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a89f33ef-42c6-4f47-b7af-9e2d6f2e339e tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:11.513195 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a89f33ef-42c6-4f47-b7af-9e2d6f2e339e tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:11.513731 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a89f33ef-42c6-4f47-b7af-9e2d6f2e339e tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:11.516139 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.wsgi [None req-359b1736-f655-4019-9c0d-0159349ea015 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] HTTP exception thrown: Instance cb70e18b-43bf-402d-9d70-028908bfc7fd could not be found. Jun 07 08:49:11.518160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-359b1736-f655-4019-9c0d-0159349ea015 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Request method failure captured: Jun 07 08:49:11.518160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: request: GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd HTTP/1.1 Jun 07 08:49:11.518160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept: application/json Jun 07 08:49:11.518160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept-Encoding: identity Jun 07 08:49:11.518160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Connection: close Jun 07 08:49:11.518160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Length: 0 Jun 07 08:49:11.518160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Type: application/json Jun 07 08:49:11.518160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Host: 10.222.0.17 Jun 07 08:49:11.518160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Openstack-System-Scope: None Jun 07 08:49:11.518160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: User-Agent: python-urllib3/1.26.9 Jun 07 08:49:11.518160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Auth-Token: gAAAAABinw_QPped87EzAmwoiZpNdXyZB0f4BNkbGDbWh-n7MFe1tVEAzf_mmm-Jck5Ac0y5B2tAP87tIbsGDXnjhIrZGa73CM_VyBSa2bcMqcVo0j1OEhmOrsAgqz-XIdaE1XL1JqCcZewtOf-1jePIT8F-b71kCKndlpE3sm19BX2InQBEHcY Jun 07 08:49:11.518160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Id: None Jun 07 08:49:11.518160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Name: None Jun 07 08:49:11.518160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Identity-Status: Confirmed Jun 07 08:49:11.518160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Is-Admin-Project: True Jun 07 08:49:11.518160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Id: default Jun 07 08:49:11.518160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Name: Default Jun 07 08:49:11.518160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Id: bfc85651f1d947e3b52f02b4cf8e26b3 Jun 07 08:49:11.518160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Name: tempest-TestShelveInstance-8855220 Jun 07 08:49:11.518160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Role: reader,member Jun 07 08:49:11.518160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Roles: reader,member Jun 07 08:49:11.519969 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bfc85651f1d947e3b52f02b4cf8e26b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bfc85651f1d947e3b52f02b4cf8e26b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bfc85651f1d947e3b52f02b4cf8e26b3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bfc85651f1d947e3b52f02b4cf8e26b3"}]}] Jun 07 08:49:11.519969 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant: tempest-TestShelveInstance-8855220 Jun 07 08:49:11.519969 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Id: bfc85651f1d947e3b52f02b4cf8e26b3 Jun 07 08:49:11.519969 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Name: tempest-TestShelveInstance-8855220 Jun 07 08:49:11.519969 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User: tempest-TestShelveInstance-8855220-project Jun 07 08:49:11.519969 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Id: default Jun 07 08:49:11.519969 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Name: Default Jun 07 08:49:11.519969 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Id: 346ec431db3947ea97f1f2e3b27db0a0 Jun 07 08:49:11.519969 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Name: tempest-TestShelveInstance-8855220-project Jun 07 08:49:11.519969 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: method: > Jun 07 08:49:11.519969 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: exception: Instance cb70e18b-43bf-402d-9d70-028908bfc7fd could not be found. Jun 07 08:49:11.519969 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: action_args: {'id': 'cb70e18b-43bf-402d-9d70-028908bfc7fd'} Jun 07 08:49:11.521168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:49:11.521168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:49:11.521168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:49:11.521168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:49:11.521168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:49:11.521168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:49:11.521168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:49:11.521168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:49:11.521168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:49:11.521168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:49:11.521168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb70e18b-43bf-402d-9d70-028908bfc7fd could not be found. Jun 07 08:49:11.521168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:49:11.521168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:49:11.521168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:49:11.521168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:49:11.521168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:49:11.521168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:49:11.521168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:49:11.521168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:49:11.521168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:49:11.522725 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:49:11.522725 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 08:49:11.522725 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 08:49:11.522725 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:49:11.522725 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:49:11.522725 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:49:11.522725 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:49:11.522725 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb70e18b-43bf-402d-9d70-028908bfc7fd could not be found. Jun 07 08:49:11.522725 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:49:11.522725 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:49:11.522725 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:49:11.522725 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:49:11.522725 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:49:11.522725 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:49:11.522725 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:49:11.522725 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:49:11.522725 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb70e18b-43bf-402d-9d70-028908bfc7fd could not be found. Jun 07 08:49:11.522725 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:49:11.524703 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-359b1736-f655-4019-9c0d-0159349ea015 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Returning 404 to user: Instance cb70e18b-43bf-402d-9d70-028908bfc7fd could not be found. {{(pid=129725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:49:11.524703 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-359b1736-f655-4019-9c0d-0159349ea015 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd" status: 404 len: 111 microversion: 2.1 time: 0.033866 Jun 07 08:49:11.524703 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 507/1007] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:49:11 2022] GET /compute/v2.1/servers/cb70e18b-43bf-402d-9d70-028908bfc7fd => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:49:11.659095 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-a89f33ef-42c6-4f47-b7af-9e2d6f2e339e tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:49:11.666915 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-a89f33ef-42c6-4f47-b7af-9e2d6f2e339e tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5" status: 200 len: 1367 microversion: 2.1 time: 0.169314 Jun 07 08:49:11.667993 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 501/1008] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:49:11 2022] GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:49:11.812573 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-c1ef3ca1-308b-4c51-94a4-4c564e88db64 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] Calling method '.version_select at 0x7f7fed37af70>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:49:11.947153 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-c1ef3ca1-308b-4c51-94a4-4c564e88db64 tempest-TestShelveInstance-8855220 tempest-TestShelveInstance-8855220-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1080759724" status: 202 len: 0 microversion: 2.1 time: 0.138397 Jun 07 08:49:11.947830 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 508/1009] 10.222.0.17 () {58 vars in 1253 bytes} [Tue Jun 7 08:49:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1080759724 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 08:49:12.687856 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-93a06739-a219-4d64-a4a5-f1df07146c29 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:49:12.689009 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-93a06739-a219-4d64-a4a5-f1df07146c29 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: aec994fe-285c-4222-868f-d7b8f1e9e8b5] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:49:12.704008 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-93a06739-a219-4d64-a4a5-f1df07146c29 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:12.704480 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-93a06739-a219-4d64-a4a5-f1df07146c29 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:12.711598 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-93a06739-a219-4d64-a4a5-f1df07146c29 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:12.712067 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-93a06739-a219-4d64-a4a5-f1df07146c29 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:13.189795 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-93a06739-a219-4d64-a4a5-f1df07146c29 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:49:13.197452 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-93a06739-a219-4d64-a4a5-f1df07146c29 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5" status: 200 len: 1367 microversion: 2.1 time: 0.516417 Jun 07 08:49:13.202171 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 502/1010] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:49:12 2022] GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5 => generated 1367 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:49:14.215236 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-33a0c3de-4919-4d75-b62e-c0fea0ddbc75 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:49:14.215849 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-33a0c3de-4919-4d75-b62e-c0fea0ddbc75 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: aec994fe-285c-4222-868f-d7b8f1e9e8b5] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:49:14.218257 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell0:SELECT=2 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:49:14.230180 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-33a0c3de-4919-4d75-b62e-c0fea0ddbc75 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:14.230180 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-33a0c3de-4919-4d75-b62e-c0fea0ddbc75 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:14.230180 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-33a0c3de-4919-4d75-b62e-c0fea0ddbc75 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:14.230180 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-33a0c3de-4919-4d75-b62e-c0fea0ddbc75 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:14.729266 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-33a0c3de-4919-4d75-b62e-c0fea0ddbc75 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:49:14.737844 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-33a0c3de-4919-4d75-b62e-c0fea0ddbc75 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5" status: 200 len: 1367 microversion: 2.1 time: 0.526524 Jun 07 08:49:14.743261 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 509/1011] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:49:14 2022] GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5 => generated 1367 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:49:15.756521 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-5f204e74-b95d-4423-9c51-52f2d1ce449e tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:49:15.758024 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-5f204e74-b95d-4423-9c51-52f2d1ce449e tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: aec994fe-285c-4222-868f-d7b8f1e9e8b5] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:49:15.760063 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell0:SELECT=2 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:49:15.762028 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell0:SELECT=10 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:49:15.767959 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5f204e74-b95d-4423-9c51-52f2d1ce449e tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:15.768830 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5f204e74-b95d-4423-9c51-52f2d1ce449e tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:15.769811 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5f204e74-b95d-4423-9c51-52f2d1ce449e tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:15.770253 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5f204e74-b95d-4423-9c51-52f2d1ce449e tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:16.006291 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-5f204e74-b95d-4423-9c51-52f2d1ce449e tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:49:16.015800 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-5f204e74-b95d-4423-9c51-52f2d1ce449e tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5" status: 200 len: 1367 microversion: 2.1 time: 0.263961 Jun 07 08:49:16.016470 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 503/1012] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:49:15 2022] GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5 => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:49:17.035978 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-c572cfbd-d143-4340-9f1d-0078ced343a4 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:49:17.036849 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-c572cfbd-d143-4340-9f1d-0078ced343a4 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: aec994fe-285c-4222-868f-d7b8f1e9e8b5] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:49:17.044725 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c572cfbd-d143-4340-9f1d-0078ced343a4 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:17.045389 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c572cfbd-d143-4340-9f1d-0078ced343a4 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:17.046254 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c572cfbd-d143-4340-9f1d-0078ced343a4 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:17.047018 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c572cfbd-d143-4340-9f1d-0078ced343a4 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:17.135703 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-53120ab8-7f49-4f36-824d-a2565a0804ee req-59643813-c488-4dc0-8ce0-77a42c6629e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aec994fe-285c-4222-868f-d7b8f1e9e8b5", "name": "network-vif-plugged", "status": "completed", "tag": "f71f2a85-4cbe-4f0e-b841-67afab91baf3"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:49:17.152828 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-53120ab8-7f49-4f36-824d-a2565a0804ee req-59643813-c488-4dc0-8ce0-77a42c6629e4 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:17.153497 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-53120ab8-7f49-4f36-824d-a2565a0804ee req-59643813-c488-4dc0-8ce0-77a42c6629e4 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:17.167433 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-53120ab8-7f49-4f36-824d-a2565a0804ee req-59643813-c488-4dc0-8ce0-77a42c6629e4 service nova] Creating event network-vif-plugged:f71f2a85-4cbe-4f0e-b841-67afab91baf3 for instance aec994fe-285c-4222-868f-d7b8f1e9e8b5 on hv-cinder-74014 Jun 07 08:49:17.173326 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-53120ab8-7f49-4f36-824d-a2565a0804ee req-59643813-c488-4dc0-8ce0-77a42c6629e4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041092 Jun 07 08:49:17.174267 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 504/1013] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:49:17.210854 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-c572cfbd-d143-4340-9f1d-0078ced343a4 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:49:17.223229 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-c572cfbd-d143-4340-9f1d-0078ced343a4 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5" status: 200 len: 1367 microversion: 2.1 time: 0.192852 Jun 07 08:49:17.225659 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 510/1014] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:49:17 2022] GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:49:18.246216 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-94e6bcef-de56-4d47-9fa5-8eedccc449fc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:49:18.247538 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-94e6bcef-de56-4d47-9fa5-8eedccc449fc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: aec994fe-285c-4222-868f-d7b8f1e9e8b5] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:49:18.255422 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-94e6bcef-de56-4d47-9fa5-8eedccc449fc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:18.256082 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-94e6bcef-de56-4d47-9fa5-8eedccc449fc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:18.257512 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-94e6bcef-de56-4d47-9fa5-8eedccc449fc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:18.257818 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-94e6bcef-de56-4d47-9fa5-8eedccc449fc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:18.455895 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-94e6bcef-de56-4d47-9fa5-8eedccc449fc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:49:18.465107 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-94e6bcef-de56-4d47-9fa5-8eedccc449fc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5" status: 200 len: 1367 microversion: 2.1 time: 0.222540 Jun 07 08:49:18.466171 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 505/1015] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:49:18 2022] GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:49:19.483412 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-5c020827-15b7-4d69-85b5-50e594bce52c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:49:19.485060 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-5c020827-15b7-4d69-85b5-50e594bce52c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: aec994fe-285c-4222-868f-d7b8f1e9e8b5] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:49:19.491265 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5c020827-15b7-4d69-85b5-50e594bce52c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:19.491775 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5c020827-15b7-4d69-85b5-50e594bce52c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:19.492874 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5c020827-15b7-4d69-85b5-50e594bce52c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:19.493163 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-5c020827-15b7-4d69-85b5-50e594bce52c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:19.643846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-5c020827-15b7-4d69-85b5-50e594bce52c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:49:19.652201 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-5c020827-15b7-4d69-85b5-50e594bce52c tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5" status: 200 len: 1557 microversion: 2.1 time: 0.173025 Jun 07 08:49:19.652755 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 511/1016] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:49:19 2022] GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5 => generated 1557 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:49:19.668642 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-8d6a62f0-6876-4d7a-b35d-c24752e35570 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:49:19.674740 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-8d6a62f0-6876-4d7a-b35d-c24752e35570 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: aec994fe-285c-4222-868f-d7b8f1e9e8b5] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:49:19.674740 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:49:19.676020 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8d6a62f0-6876-4d7a-b35d-c24752e35570 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:19.676466 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8d6a62f0-6876-4d7a-b35d-c24752e35570 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:19.677257 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8d6a62f0-6876-4d7a-b35d-c24752e35570 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:19.677749 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8d6a62f0-6876-4d7a-b35d-c24752e35570 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:19.786596 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-8d6a62f0-6876-4d7a-b35d-c24752e35570 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.121700 Jun 07 08:49:19.787188 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 506/1017] 10.222.0.17 () {58 vars in 1274 bytes} [Tue Jun 7 08:49:19 2022] GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5/os-interface => generated 284 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:49:20.811023 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-0a83fa36-369f-4f19-966d-6c62286cdb7e req-f0295817-f780-441a-9f50-bacb6633e821 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aec994fe-285c-4222-868f-d7b8f1e9e8b5", "tag": "f71f2a85-4cbe-4f0e-b841-67afab91baf3"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:49:20.819538 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-0a83fa36-369f-4f19-966d-6c62286cdb7e req-f0295817-f780-441a-9f50-bacb6633e821 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:20.819981 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-0a83fa36-369f-4f19-966d-6c62286cdb7e req-f0295817-f780-441a-9f50-bacb6633e821 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:20.831331 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-0a83fa36-369f-4f19-966d-6c62286cdb7e req-f0295817-f780-441a-9f50-bacb6633e821 service nova] Creating event network-changed:f71f2a85-4cbe-4f0e-b841-67afab91baf3 for instance aec994fe-285c-4222-868f-d7b8f1e9e8b5 on hv-cinder-74014 Jun 07 08:49:20.836576 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-0a83fa36-369f-4f19-966d-6c62286cdb7e req-f0295817-f780-441a-9f50-bacb6633e821 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029354 Jun 07 08:49:20.837307 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 512/1018] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:49:58.433898 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=58 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:49:58.438264 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-aff9f0a4-5a87-4bca-85fc-562551f39a76 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:49:58.438996 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-aff9f0a4-5a87-4bca-85fc-562551f39a76 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: aec994fe-285c-4222-868f-d7b8f1e9e8b5] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:49:58.446284 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-aff9f0a4-5a87-4bca-85fc-562551f39a76 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:58.446730 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-aff9f0a4-5a87-4bca-85fc-562551f39a76 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:58.447538 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-aff9f0a4-5a87-4bca-85fc-562551f39a76 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:49:58.447972 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-aff9f0a4-5a87-4bca-85fc-562551f39a76 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:49:58.472054 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-aff9f0a4-5a87-4bca-85fc-562551f39a76 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5/ips" status: 200 len: 149 microversion: 2.1 time: 0.040283 Jun 07 08:49:58.477424 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 507/1019] 10.222.0.17 () {58 vars in 1247 bytes} [Tue Jun 7 08:49:58 2022] GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:50:00.070724 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:50:00.071560 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=25 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:50:00.075814 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-34183aa5-9d6a-4dad-a32f-123f6fb10cd9 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b89114af-f3b9-40c4-8636-6c5392325b52"}} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:50:00.077686 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-34183aa5-9d6a-4dad-a32f-123f6fb10cd9 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: aec994fe-285c-4222-868f-d7b8f1e9e8b5] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:50:00.083805 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-34183aa5-9d6a-4dad-a32f-123f6fb10cd9 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:00.084342 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-34183aa5-9d6a-4dad-a32f-123f6fb10cd9 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:00.085041 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-34183aa5-9d6a-4dad-a32f-123f6fb10cd9 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:00.085479 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-34183aa5-9d6a-4dad-a32f-123f6fb10cd9 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:00.904160 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-34183aa5-9d6a-4dad-a32f-123f6fb10cd9 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "POST /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.834794 Jun 07 08:50:00.904902 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 513/1020] 10.222.0.17 () {60 vars in 1322 bytes} [Tue Jun 7 08:50:00 2022] POST /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5/os-volume_attachments => generated 194 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:50:08.497737 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-a7d0606c-7630-4e53-831f-325adbdfdf78 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:50:08.498283 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-a7d0606c-7630-4e53-831f-325adbdfdf78 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: aec994fe-285c-4222-868f-d7b8f1e9e8b5] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:50:08.505837 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a7d0606c-7630-4e53-831f-325adbdfdf78 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:08.506294 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a7d0606c-7630-4e53-831f-325adbdfdf78 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:08.507074 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a7d0606c-7630-4e53-831f-325adbdfdf78 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:08.507582 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a7d0606c-7630-4e53-831f-325adbdfdf78 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:08.591465 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.objects.instance [None req-a7d0606c-7630-4e53-831f-325adbdfdf78 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lazy-loading 'services' on Instance uuid aec994fe-285c-4222-868f-d7b8f1e9e8b5 {{(pid=129726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:50:08.823990 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-a7d0606c-7630-4e53-831f-325adbdfdf78 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "DELETE /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5/os-volume_attachments/b89114af-f3b9-40c4-8636-6c5392325b52" status: 202 len: 0 microversion: 2.1 time: 0.330602 Jun 07 08:50:08.824589 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 508/1021] 10.222.0.17 () {58 vars in 1415 bytes} [Tue Jun 7 08:50:08 2022] DELETE /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5/os-volume_attachments/b89114af-f3b9-40c4-8636-6c5392325b52 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 08:50:08.834087 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-4e455897-6de9-43b2-817d-23c8778c02bc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:50:08.835202 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-4e455897-6de9-43b2-817d-23c8778c02bc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: aec994fe-285c-4222-868f-d7b8f1e9e8b5] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:50:08.841919 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4e455897-6de9-43b2-817d-23c8778c02bc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:08.842373 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4e455897-6de9-43b2-817d-23c8778c02bc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:08.843149 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4e455897-6de9-43b2-817d-23c8778c02bc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:08.843592 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4e455897-6de9-43b2-817d-23c8778c02bc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:08.878063 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-4e455897-6de9-43b2-817d-23c8778c02bc tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048835 Jun 07 08:50:08.878647 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 514/1022] 10.222.0.17 () {58 vars in 1301 bytes} [Tue Jun 7 08:50:08 2022] GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:50:09.890440 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-fa601b1d-7d3a-4038-b882-159b6dc6ae10 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:50:09.891514 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-fa601b1d-7d3a-4038-b882-159b6dc6ae10 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: aec994fe-285c-4222-868f-d7b8f1e9e8b5] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:50:09.898103 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fa601b1d-7d3a-4038-b882-159b6dc6ae10 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:09.898560 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fa601b1d-7d3a-4038-b882-159b6dc6ae10 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:09.899351 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fa601b1d-7d3a-4038-b882-159b6dc6ae10 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:09.899798 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fa601b1d-7d3a-4038-b882-159b6dc6ae10 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:09.931654 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-fa601b1d-7d3a-4038-b882-159b6dc6ae10 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045925 Jun 07 08:50:09.932327 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 509/1023] 10.222.0.17 () {58 vars in 1301 bytes} [Tue Jun 7 08:50:09 2022] GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 07 08:50:09.993115 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-15895765-1e40-43b9-abb6-4d47b9033631 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:50:09.993695 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-15895765-1e40-43b9-abb6-4d47b9033631 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: aec994fe-285c-4222-868f-d7b8f1e9e8b5] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:50:10.000888 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-15895765-1e40-43b9-abb6-4d47b9033631 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:10.001363 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-15895765-1e40-43b9-abb6-4d47b9033631 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:10.002139 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-15895765-1e40-43b9-abb6-4d47b9033631 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:10.002571 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-15895765-1e40-43b9-abb6-4d47b9033631 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:10.028782 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-15895765-1e40-43b9-abb6-4d47b9033631 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: aec994fe-285c-4222-868f-d7b8f1e9e8b5] Going to try to terminate instance {{(pid=129725) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 08:50:10.322038 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-15895765-1e40-43b9-abb6-4d47b9033631 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "DELETE /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5" status: 204 len: 0 microversion: 2.1 time: 0.332463 Jun 07 08:50:10.322704 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 515/1024] 10.222.0.17 () {58 vars in 1238 bytes} [Tue Jun 7 08:50:09 2022] DELETE /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 08:50:10.332159 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-f683f5f1-132b-4d5f-8992-9966f1b795e7 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:50:10.332781 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-f683f5f1-132b-4d5f-8992-9966f1b795e7 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: aec994fe-285c-4222-868f-d7b8f1e9e8b5] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:50:10.338981 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f683f5f1-132b-4d5f-8992-9966f1b795e7 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:10.339444 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f683f5f1-132b-4d5f-8992-9966f1b795e7 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:10.340217 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f683f5f1-132b-4d5f-8992-9966f1b795e7 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:10.340661 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f683f5f1-132b-4d5f-8992-9966f1b795e7 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:10.479717 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-f683f5f1-132b-4d5f-8992-9966f1b795e7 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:50:10.487959 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-f683f5f1-132b-4d5f-8992-9966f1b795e7 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5" status: 200 len: 1681 microversion: 2.1 time: 0.160276 Jun 07 08:50:10.491195 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 510/1025] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:50:10 2022] GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:50:11.506123 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-3e033735-23d1-4901-a19d-cb430efeefb3 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:50:11.506749 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-3e033735-23d1-4901-a19d-cb430efeefb3 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: aec994fe-285c-4222-868f-d7b8f1e9e8b5] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:50:11.513619 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3e033735-23d1-4901-a19d-cb430efeefb3 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:11.514073 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3e033735-23d1-4901-a19d-cb430efeefb3 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:11.514866 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3e033735-23d1-4901-a19d-cb430efeefb3 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:11.515304 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3e033735-23d1-4901-a19d-cb430efeefb3 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:11.651772 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-3e033735-23d1-4901-a19d-cb430efeefb3 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:50:11.660739 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-3e033735-23d1-4901-a19d-cb430efeefb3 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5" status: 200 len: 1681 microversion: 2.1 time: 0.158964 Jun 07 08:50:11.661332 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 516/1026] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:50:11 2022] GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:50:12.678262 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-f20cff33-2afe-474c-b8d5-db715fd6a622 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:50:12.678879 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-f20cff33-2afe-474c-b8d5-db715fd6a622 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: aec994fe-285c-4222-868f-d7b8f1e9e8b5] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:50:12.685576 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f20cff33-2afe-474c-b8d5-db715fd6a622 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:12.686025 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f20cff33-2afe-474c-b8d5-db715fd6a622 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:12.686830 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f20cff33-2afe-474c-b8d5-db715fd6a622 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:12.687267 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f20cff33-2afe-474c-b8d5-db715fd6a622 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:12.756517 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-f20cff33-2afe-474c-b8d5-db715fd6a622 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:50:12.765599 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-f20cff33-2afe-474c-b8d5-db715fd6a622 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5" status: 200 len: 1614 microversion: 2.1 time: 0.091137 Jun 07 08:50:12.766399 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 511/1027] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:50:12 2022] GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5 => generated 1614 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:50:13.340475 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-b6c39add-f80c-4b46-a9fb-1bcc034036a9 req-18e2274a-f904-4101-9bb5-45e570ea58de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aec994fe-285c-4222-868f-d7b8f1e9e8b5", "name": "network-vif-deleted", "tag": "f71f2a85-4cbe-4f0e-b841-67afab91baf3"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:50:13.353512 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-b6c39add-f80c-4b46-a9fb-1bcc034036a9 req-18e2274a-f904-4101-9bb5-45e570ea58de service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:13.353512 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-b6c39add-f80c-4b46-a9fb-1bcc034036a9 req-18e2274a-f904-4101-9bb5-45e570ea58de service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:13.361734 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-b6c39add-f80c-4b46-a9fb-1bcc034036a9 req-18e2274a-f904-4101-9bb5-45e570ea58de service nova] Creating event network-vif-deleted:f71f2a85-4cbe-4f0e-b841-67afab91baf3 for instance aec994fe-285c-4222-868f-d7b8f1e9e8b5 on hv-cinder-74014 Jun 07 08:50:13.366605 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-b6c39add-f80c-4b46-a9fb-1bcc034036a9 req-18e2274a-f904-4101-9bb5-45e570ea58de service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029906 Jun 07 08:50:13.367191 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 517/1028] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:50:13.785026 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-2a4f489d-4ca8-4829-8aa5-5c07f9238d39 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:50:13.785802 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-2a4f489d-4ca8-4829-8aa5-5c07f9238d39 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: aec994fe-285c-4222-868f-d7b8f1e9e8b5] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:50:13.793667 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2a4f489d-4ca8-4829-8aa5-5c07f9238d39 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:13.794190 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2a4f489d-4ca8-4829-8aa5-5c07f9238d39 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:13.795055 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2a4f489d-4ca8-4829-8aa5-5c07f9238d39 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:13.795565 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2a4f489d-4ca8-4829-8aa5-5c07f9238d39 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:13.832935 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2a4f489d-4ca8-4829-8aa5-5c07f9238d39 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:13.833418 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2a4f489d-4ca8-4829-8aa5-5c07f9238d39 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:13.833872 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.objects.instance [None req-2a4f489d-4ca8-4829-8aa5-5c07f9238d39 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lazy-loading 'fault' on Instance uuid aec994fe-285c-4222-868f-d7b8f1e9e8b5 {{(pid=129726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:50:13.874409 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-2a4f489d-4ca8-4829-8aa5-5c07f9238d39 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ddf59fe764404eb1c6ee745e21d352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0899cad1b7c64a0199b3466d4c7cfefb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:50:13.882518 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-2a4f489d-4ca8-4829-8aa5-5c07f9238d39 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5" status: 200 len: 1332 microversion: 2.1 time: 0.102657 Jun 07 08:50:13.883092 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 512/1029] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:50:13 2022] GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5 => generated 1332 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:50:14.901391 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-82086b79-619f-42f7-90d7-eede84240c10 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:50:14.902084 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-82086b79-619f-42f7-90d7-eede84240c10 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: aec994fe-285c-4222-868f-d7b8f1e9e8b5] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:50:14.908225 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-82086b79-619f-42f7-90d7-eede84240c10 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:14.908667 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-82086b79-619f-42f7-90d7-eede84240c10 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:14.909447 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-82086b79-619f-42f7-90d7-eede84240c10 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:14.909879 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-82086b79-619f-42f7-90d7-eede84240c10 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:14.923586 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.wsgi [None req-82086b79-619f-42f7-90d7-eede84240c10 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] HTTP exception thrown: Instance aec994fe-285c-4222-868f-d7b8f1e9e8b5 could not be found. Jun 07 08:50:14.925228 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-82086b79-619f-42f7-90d7-eede84240c10 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Request method failure captured: Jun 07 08:50:14.925228 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: request: GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5 HTTP/1.1 Jun 07 08:50:14.925228 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept: application/json Jun 07 08:50:14.925228 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept-Encoding: identity Jun 07 08:50:14.925228 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Connection: close Jun 07 08:50:14.925228 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Length: 0 Jun 07 08:50:14.925228 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Type: application/json Jun 07 08:50:14.925228 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Host: 10.222.0.17 Jun 07 08:50:14.925228 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Openstack-System-Scope: None Jun 07 08:50:14.925228 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: User-Agent: python-urllib3/1.26.9 Jun 07 08:50:14.925228 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Auth-Token: gAAAAABinxAgj5C7ouE1N-aaB4GYPlt92HgnY7l_4qNjeb7MhcXewkqTDq3SwhJjBOupqPwAwi-EUO3Doxu5eOmMdEwFCWQlkuqeuPwgDsRWAIP7QSDJjzl4qrePMCoCSyDT0Sg0QJjM04PVEJfbaffcjJA3z-4CjpQwrMDzvrui6SNaABiQiRQ Jun 07 08:50:14.925228 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Id: None Jun 07 08:50:14.925228 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Name: None Jun 07 08:50:14.925228 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Identity-Status: Confirmed Jun 07 08:50:14.925228 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Is-Admin-Project: True Jun 07 08:50:14.925228 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Id: default Jun 07 08:50:14.925228 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Name: Default Jun 07 08:50:14.925228 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Id: 0899cad1b7c64a0199b3466d4c7cfefb Jun 07 08:50:14.925228 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Name: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:50:14.925228 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Role: reader,member Jun 07 08:50:14.925228 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Roles: reader,member Jun 07 08:50:14.926904 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0899cad1b7c64a0199b3466d4c7cfefb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0899cad1b7c64a0199b3466d4c7cfefb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0899cad1b7c64a0199b3466d4c7cfefb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0899cad1b7c64a0199b3466d4c7cfefb"}]}] Jun 07 08:50:14.926904 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:50:14.926904 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Id: 0899cad1b7c64a0199b3466d4c7cfefb Jun 07 08:50:14.926904 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:50:14.926904 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User: tempest-AttachVolumeNegativeTest-1278776647-project Jun 07 08:50:14.926904 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Id: default Jun 07 08:50:14.926904 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Name: Default Jun 07 08:50:14.926904 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Id: 52ddf59fe764404eb1c6ee745e21d352 Jun 07 08:50:14.926904 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Name: tempest-AttachVolumeNegativeTest-1278776647-project Jun 07 08:50:14.926904 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: method: > Jun 07 08:50:14.926904 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: exception: Instance aec994fe-285c-4222-868f-d7b8f1e9e8b5 could not be found. Jun 07 08:50:14.926904 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: action_args: {'id': 'aec994fe-285c-4222-868f-d7b8f1e9e8b5'} Jun 07 08:50:14.927825 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:50:14.927825 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:50:14.927825 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:50:14.927825 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:50:14.927825 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:50:14.927825 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:50:14.927825 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:50:14.927825 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:50:14.927825 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:50:14.927825 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:50:14.927825 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aec994fe-285c-4222-868f-d7b8f1e9e8b5 could not be found. Jun 07 08:50:14.927825 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:50:14.927825 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:50:14.927825 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:50:14.927825 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:50:14.927825 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:50:14.927825 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:50:14.927825 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:50:14.927825 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:50:14.927825 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:50:14.929510 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:50:14.929510 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 08:50:14.929510 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 08:50:14.929510 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:50:14.929510 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:50:14.929510 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:50:14.929510 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:50:14.929510 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aec994fe-285c-4222-868f-d7b8f1e9e8b5 could not be found. Jun 07 08:50:14.929510 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:50:14.929510 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:50:14.929510 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:50:14.929510 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:50:14.929510 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:50:14.929510 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:50:14.929510 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:50:14.929510 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:50:14.929510 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aec994fe-285c-4222-868f-d7b8f1e9e8b5 could not be found. Jun 07 08:50:14.929510 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:50:14.930931 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-82086b79-619f-42f7-90d7-eede84240c10 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Returning 404 to user: Instance aec994fe-285c-4222-868f-d7b8f1e9e8b5 could not be found. {{(pid=129725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:50:14.930931 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-82086b79-619f-42f7-90d7-eede84240c10 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5" status: 404 len: 111 microversion: 2.1 time: 0.030481 Jun 07 08:50:14.930931 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 518/1030] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:50:14 2022] GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:50:14.935383 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-23784fb3-c7d7-407f-84c7-77a45a8c0f80 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '.version_select at 0x7f7fecd3fd30>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:50:15.014782 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-23784fb3-c7d7-407f-84c7-77a45a8c0f80 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1740331994" status: 202 len: 0 microversion: 2.1 time: 0.083023 Jun 07 08:50:15.015368 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 513/1031] 10.222.0.17 () {58 vars in 1220 bytes} [Tue Jun 7 08:50:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1740331994 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 07 08:50:17.072944 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-9850091f-4750-4e57-a7e0-3ac533584af0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:50:17.076978 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-9850091f-4750-4e57-a7e0-3ac533584af0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: aec994fe-285c-4222-868f-d7b8f1e9e8b5] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:50:17.079885 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9850091f-4750-4e57-a7e0-3ac533584af0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:17.080344 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9850091f-4750-4e57-a7e0-3ac533584af0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:17.081141 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9850091f-4750-4e57-a7e0-3ac533584af0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:17.081589 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-9850091f-4750-4e57-a7e0-3ac533584af0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:17.095423 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.wsgi [None req-9850091f-4750-4e57-a7e0-3ac533584af0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] HTTP exception thrown: Instance aec994fe-285c-4222-868f-d7b8f1e9e8b5 could not be found. Jun 07 08:50:17.099863 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-9850091f-4750-4e57-a7e0-3ac533584af0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Request method failure captured: Jun 07 08:50:17.099863 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: request: DELETE /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5 HTTP/1.1 Jun 07 08:50:17.099863 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept: application/json Jun 07 08:50:17.099863 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept-Encoding: identity Jun 07 08:50:17.099863 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Connection: close Jun 07 08:50:17.099863 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Length: 0 Jun 07 08:50:17.099863 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Type: application/json Jun 07 08:50:17.099863 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Host: 10.222.0.17 Jun 07 08:50:17.099863 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Openstack-System-Scope: None Jun 07 08:50:17.099863 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: User-Agent: python-urllib3/1.26.9 Jun 07 08:50:17.099863 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Auth-Token: gAAAAABinxAgj5C7ouE1N-aaB4GYPlt92HgnY7l_4qNjeb7MhcXewkqTDq3SwhJjBOupqPwAwi-EUO3Doxu5eOmMdEwFCWQlkuqeuPwgDsRWAIP7QSDJjzl4qrePMCoCSyDT0Sg0QJjM04PVEJfbaffcjJA3z-4CjpQwrMDzvrui6SNaABiQiRQ Jun 07 08:50:17.099863 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Id: None Jun 07 08:50:17.099863 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Name: None Jun 07 08:50:17.099863 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Identity-Status: Confirmed Jun 07 08:50:17.099863 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Is-Admin-Project: True Jun 07 08:50:17.099863 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Id: default Jun 07 08:50:17.099863 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Name: Default Jun 07 08:50:17.099863 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Id: 0899cad1b7c64a0199b3466d4c7cfefb Jun 07 08:50:17.099863 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Name: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:50:17.099863 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Role: reader,member Jun 07 08:50:17.099863 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Roles: reader,member Jun 07 08:50:17.101533 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0899cad1b7c64a0199b3466d4c7cfefb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0899cad1b7c64a0199b3466d4c7cfefb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0899cad1b7c64a0199b3466d4c7cfefb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0899cad1b7c64a0199b3466d4c7cfefb"}]}] Jun 07 08:50:17.101533 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:50:17.101533 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Id: 0899cad1b7c64a0199b3466d4c7cfefb Jun 07 08:50:17.101533 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:50:17.101533 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User: tempest-AttachVolumeNegativeTest-1278776647-project Jun 07 08:50:17.101533 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Id: default Jun 07 08:50:17.101533 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Name: Default Jun 07 08:50:17.101533 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Id: 52ddf59fe764404eb1c6ee745e21d352 Jun 07 08:50:17.101533 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Name: tempest-AttachVolumeNegativeTest-1278776647-project Jun 07 08:50:17.101533 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: method: > Jun 07 08:50:17.101533 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: exception: Instance aec994fe-285c-4222-868f-d7b8f1e9e8b5 could not be found. Jun 07 08:50:17.101533 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: action_args: {'id': 'aec994fe-285c-4222-868f-d7b8f1e9e8b5'} Jun 07 08:50:17.102456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:50:17.102456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:50:17.102456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:50:17.102456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:50:17.102456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:50:17.102456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:50:17.102456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:50:17.102456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:50:17.102456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:50:17.102456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:50:17.102456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aec994fe-285c-4222-868f-d7b8f1e9e8b5 could not be found. Jun 07 08:50:17.102456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:50:17.102456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:50:17.102456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:50:17.102456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:50:17.102456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:50:17.102456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:50:17.102456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:50:17.102456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:50:17.102456 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:50:17.103949 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:50:17.103949 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 08:50:17.103949 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 08:50:17.103949 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 08:50:17.103949 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 08:50:17.103949 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:50:17.103949 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:50:17.103949 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:50:17.103949 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:50:17.103949 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aec994fe-285c-4222-868f-d7b8f1e9e8b5 could not be found. Jun 07 08:50:17.103949 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:50:17.103949 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:50:17.103949 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:50:17.103949 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:50:17.103949 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:50:17.103949 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:50:17.103949 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:50:17.103949 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:50:17.103949 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aec994fe-285c-4222-868f-d7b8f1e9e8b5 could not be found. Jun 07 08:50:17.103949 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:50:17.105407 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-9850091f-4750-4e57-a7e0-3ac533584af0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Returning 404 to user: Instance aec994fe-285c-4222-868f-d7b8f1e9e8b5 could not be found. {{(pid=129725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:50:17.105407 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-9850091f-4750-4e57-a7e0-3ac533584af0 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "DELETE /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5" status: 404 len: 111 microversion: 2.1 time: 0.029255 Jun 07 08:50:17.105407 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 519/1032] 10.222.0.17 () {58 vars in 1238 bytes} [Tue Jun 7 08:50:17 2022] DELETE /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:50:17.106687 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-425adb8e-4a3c-4493-873b-4262c104cf24 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:50:17.107301 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-425adb8e-4a3c-4493-873b-4262c104cf24 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: aec994fe-285c-4222-868f-d7b8f1e9e8b5] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:50:17.115311 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-425adb8e-4a3c-4493-873b-4262c104cf24 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:17.115766 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-425adb8e-4a3c-4493-873b-4262c104cf24 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:17.116530 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-425adb8e-4a3c-4493-873b-4262c104cf24 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:17.116968 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-425adb8e-4a3c-4493-873b-4262c104cf24 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:17.129871 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.wsgi [None req-425adb8e-4a3c-4493-873b-4262c104cf24 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] HTTP exception thrown: Instance aec994fe-285c-4222-868f-d7b8f1e9e8b5 could not be found. Jun 07 08:50:17.131533 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-425adb8e-4a3c-4493-873b-4262c104cf24 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Request method failure captured: Jun 07 08:50:17.131533 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: request: GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5 HTTP/1.1 Jun 07 08:50:17.131533 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept: application/json Jun 07 08:50:17.131533 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept-Encoding: identity Jun 07 08:50:17.131533 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Connection: close Jun 07 08:50:17.131533 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Length: 0 Jun 07 08:50:17.131533 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Type: application/json Jun 07 08:50:17.131533 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Host: 10.222.0.17 Jun 07 08:50:17.131533 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Openstack-System-Scope: None Jun 07 08:50:17.131533 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: User-Agent: python-urllib3/1.26.9 Jun 07 08:50:17.131533 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Auth-Token: gAAAAABinxAgj5C7ouE1N-aaB4GYPlt92HgnY7l_4qNjeb7MhcXewkqTDq3SwhJjBOupqPwAwi-EUO3Doxu5eOmMdEwFCWQlkuqeuPwgDsRWAIP7QSDJjzl4qrePMCoCSyDT0Sg0QJjM04PVEJfbaffcjJA3z-4CjpQwrMDzvrui6SNaABiQiRQ Jun 07 08:50:17.131533 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Id: None Jun 07 08:50:17.131533 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Name: None Jun 07 08:50:17.131533 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Identity-Status: Confirmed Jun 07 08:50:17.131533 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Is-Admin-Project: True Jun 07 08:50:17.131533 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Id: default Jun 07 08:50:17.131533 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Name: Default Jun 07 08:50:17.131533 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Id: 0899cad1b7c64a0199b3466d4c7cfefb Jun 07 08:50:17.131533 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:50:17.131533 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Role: reader,member Jun 07 08:50:17.131533 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Roles: reader,member Jun 07 08:50:17.132940 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0899cad1b7c64a0199b3466d4c7cfefb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0899cad1b7c64a0199b3466d4c7cfefb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0899cad1b7c64a0199b3466d4c7cfefb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0899cad1b7c64a0199b3466d4c7cfefb"}]}] Jun 07 08:50:17.132940 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:50:17.132940 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Id: 0899cad1b7c64a0199b3466d4c7cfefb Jun 07 08:50:17.132940 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:50:17.132940 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User: tempest-AttachVolumeNegativeTest-1278776647-project Jun 07 08:50:17.132940 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Id: default Jun 07 08:50:17.132940 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Name: Default Jun 07 08:50:17.132940 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Id: 52ddf59fe764404eb1c6ee745e21d352 Jun 07 08:50:17.132940 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Name: tempest-AttachVolumeNegativeTest-1278776647-project Jun 07 08:50:17.132940 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: method: > Jun 07 08:50:17.132940 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: exception: Instance aec994fe-285c-4222-868f-d7b8f1e9e8b5 could not be found. Jun 07 08:50:17.132940 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: action_args: {'id': 'aec994fe-285c-4222-868f-d7b8f1e9e8b5'} Jun 07 08:50:17.134581 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:50:17.134581 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:50:17.134581 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:50:17.134581 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:50:17.134581 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:50:17.134581 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:50:17.134581 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:50:17.134581 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:50:17.134581 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:50:17.134581 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:50:17.134581 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aec994fe-285c-4222-868f-d7b8f1e9e8b5 could not be found. Jun 07 08:50:17.134581 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:50:17.134581 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:50:17.134581 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:50:17.134581 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:50:17.134581 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:50:17.134581 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:50:17.134581 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:50:17.134581 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:50:17.134581 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:50:17.136100 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:50:17.136100 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 08:50:17.136100 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 08:50:17.136100 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:50:17.136100 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:50:17.136100 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:50:17.136100 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:50:17.136100 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aec994fe-285c-4222-868f-d7b8f1e9e8b5 could not be found. Jun 07 08:50:17.136100 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:50:17.136100 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:50:17.136100 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:50:17.136100 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:50:17.136100 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:50:17.136100 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:50:17.136100 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:50:17.136100 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:50:17.136100 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aec994fe-285c-4222-868f-d7b8f1e9e8b5 could not be found. Jun 07 08:50:17.136100 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:50:17.137803 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-425adb8e-4a3c-4493-873b-4262c104cf24 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Returning 404 to user: Instance aec994fe-285c-4222-868f-d7b8f1e9e8b5 could not be found. {{(pid=129726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:50:17.137803 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-425adb8e-4a3c-4493-873b-4262c104cf24 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5" status: 404 len: 111 microversion: 2.1 time: 0.029992 Jun 07 08:50:17.137803 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 514/1033] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:50:17 2022] GET /compute/v2.1/servers/aec994fe-285c-4222-868f-d7b8f1e9e8b5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:50:18.393495 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-57ad926d-d76b-4c3d-8d18-05b759135ee6 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:50:18.394029 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-57ad926d-d76b-4c3d-8d18-05b759135ee6 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: 08308b76-0df7-4c43-a434-6880034a8c54] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:50:18.400781 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-57ad926d-d76b-4c3d-8d18-05b759135ee6 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:18.401485 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-57ad926d-d76b-4c3d-8d18-05b759135ee6 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:18.402233 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-57ad926d-d76b-4c3d-8d18-05b759135ee6 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:18.402675 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-57ad926d-d76b-4c3d-8d18-05b759135ee6 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:18.417193 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.wsgi [None req-57ad926d-d76b-4c3d-8d18-05b759135ee6 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] HTTP exception thrown: Instance 08308b76-0df7-4c43-a434-6880034a8c54 could not be found. Jun 07 08:50:18.418858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-57ad926d-d76b-4c3d-8d18-05b759135ee6 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Request method failure captured: Jun 07 08:50:18.418858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: request: DELETE /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54 HTTP/1.1 Jun 07 08:50:18.418858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept: application/json Jun 07 08:50:18.418858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept-Encoding: identity Jun 07 08:50:18.418858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Connection: close Jun 07 08:50:18.418858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Length: 0 Jun 07 08:50:18.418858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Type: application/json Jun 07 08:50:18.418858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Host: 10.222.0.17 Jun 07 08:50:18.418858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Openstack-System-Scope: None Jun 07 08:50:18.418858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: User-Agent: python-urllib3/1.26.9 Jun 07 08:50:18.418858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Auth-Token: gAAAAABinxAgj5C7ouE1N-aaB4GYPlt92HgnY7l_4qNjeb7MhcXewkqTDq3SwhJjBOupqPwAwi-EUO3Doxu5eOmMdEwFCWQlkuqeuPwgDsRWAIP7QSDJjzl4qrePMCoCSyDT0Sg0QJjM04PVEJfbaffcjJA3z-4CjpQwrMDzvrui6SNaABiQiRQ Jun 07 08:50:18.418858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Id: None Jun 07 08:50:18.418858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Name: None Jun 07 08:50:18.418858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Identity-Status: Confirmed Jun 07 08:50:18.418858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Is-Admin-Project: True Jun 07 08:50:18.418858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Id: default Jun 07 08:50:18.418858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Name: Default Jun 07 08:50:18.418858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Id: 0899cad1b7c64a0199b3466d4c7cfefb Jun 07 08:50:18.418858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Name: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:50:18.418858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Role: reader,member Jun 07 08:50:18.418858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Roles: reader,member Jun 07 08:50:18.420459 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0899cad1b7c64a0199b3466d4c7cfefb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0899cad1b7c64a0199b3466d4c7cfefb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0899cad1b7c64a0199b3466d4c7cfefb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0899cad1b7c64a0199b3466d4c7cfefb"}]}] Jun 07 08:50:18.420459 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:50:18.420459 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Id: 0899cad1b7c64a0199b3466d4c7cfefb Jun 07 08:50:18.420459 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:50:18.420459 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User: tempest-AttachVolumeNegativeTest-1278776647-project Jun 07 08:50:18.420459 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Id: default Jun 07 08:50:18.420459 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Name: Default Jun 07 08:50:18.420459 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Id: 52ddf59fe764404eb1c6ee745e21d352 Jun 07 08:50:18.420459 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Name: tempest-AttachVolumeNegativeTest-1278776647-project Jun 07 08:50:18.420459 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: method: > Jun 07 08:50:18.420459 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: exception: Instance 08308b76-0df7-4c43-a434-6880034a8c54 could not be found. Jun 07 08:50:18.420459 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: action_args: {'id': '08308b76-0df7-4c43-a434-6880034a8c54'} Jun 07 08:50:18.421425 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:50:18.421425 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:50:18.421425 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:50:18.421425 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:50:18.421425 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:50:18.421425 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:50:18.421425 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:50:18.421425 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:50:18.421425 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:50:18.421425 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:50:18.421425 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08308b76-0df7-4c43-a434-6880034a8c54 could not be found. Jun 07 08:50:18.421425 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:50:18.421425 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:50:18.421425 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:50:18.421425 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:50:18.421425 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:50:18.421425 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:50:18.421425 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:50:18.421425 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:50:18.421425 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:50:18.423488 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:50:18.423488 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 08:50:18.423488 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 08:50:18.423488 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 08:50:18.423488 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 08:50:18.423488 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:50:18.423488 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:50:18.423488 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:50:18.423488 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:50:18.423488 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08308b76-0df7-4c43-a434-6880034a8c54 could not be found. Jun 07 08:50:18.423488 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:50:18.423488 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:50:18.423488 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:50:18.423488 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:50:18.423488 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:50:18.423488 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:50:18.423488 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:50:18.423488 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:50:18.423488 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08308b76-0df7-4c43-a434-6880034a8c54 could not be found. Jun 07 08:50:18.423488 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:50:18.424951 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-57ad926d-d76b-4c3d-8d18-05b759135ee6 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Returning 404 to user: Instance 08308b76-0df7-4c43-a434-6880034a8c54 could not be found. {{(pid=129725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:50:18.424951 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-57ad926d-d76b-4c3d-8d18-05b759135ee6 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "DELETE /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54" status: 404 len: 111 microversion: 2.1 time: 0.031269 Jun 07 08:50:18.424951 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 520/1034] 10.222.0.17 () {58 vars in 1238 bytes} [Tue Jun 7 08:50:18 2022] DELETE /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:50:18.429616 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-a5d688d9-d899-4e6f-a6c5-36236fee68ee tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:50:18.432630 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-a5d688d9-d899-4e6f-a6c5-36236fee68ee tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: 08308b76-0df7-4c43-a434-6880034a8c54] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:50:18.436969 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a5d688d9-d899-4e6f-a6c5-36236fee68ee tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:18.437451 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a5d688d9-d899-4e6f-a6c5-36236fee68ee tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:18.438241 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a5d688d9-d899-4e6f-a6c5-36236fee68ee tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:18.438780 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a5d688d9-d899-4e6f-a6c5-36236fee68ee tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:18.452448 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.wsgi [None req-a5d688d9-d899-4e6f-a6c5-36236fee68ee tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] HTTP exception thrown: Instance 08308b76-0df7-4c43-a434-6880034a8c54 could not be found. Jun 07 08:50:18.454079 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-a5d688d9-d899-4e6f-a6c5-36236fee68ee tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Request method failure captured: Jun 07 08:50:18.454079 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: request: GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54 HTTP/1.1 Jun 07 08:50:18.454079 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept: application/json Jun 07 08:50:18.454079 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept-Encoding: identity Jun 07 08:50:18.454079 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Connection: close Jun 07 08:50:18.454079 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Length: 0 Jun 07 08:50:18.454079 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Type: application/json Jun 07 08:50:18.454079 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Host: 10.222.0.17 Jun 07 08:50:18.454079 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Openstack-System-Scope: None Jun 07 08:50:18.454079 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: User-Agent: python-urllib3/1.26.9 Jun 07 08:50:18.454079 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Auth-Token: gAAAAABinxAgj5C7ouE1N-aaB4GYPlt92HgnY7l_4qNjeb7MhcXewkqTDq3SwhJjBOupqPwAwi-EUO3Doxu5eOmMdEwFCWQlkuqeuPwgDsRWAIP7QSDJjzl4qrePMCoCSyDT0Sg0QJjM04PVEJfbaffcjJA3z-4CjpQwrMDzvrui6SNaABiQiRQ Jun 07 08:50:18.454079 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Id: None Jun 07 08:50:18.454079 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Name: None Jun 07 08:50:18.454079 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Identity-Status: Confirmed Jun 07 08:50:18.454079 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Is-Admin-Project: True Jun 07 08:50:18.454079 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Id: default Jun 07 08:50:18.454079 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Name: Default Jun 07 08:50:18.454079 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Id: 0899cad1b7c64a0199b3466d4c7cfefb Jun 07 08:50:18.454079 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:50:18.454079 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Role: reader,member Jun 07 08:50:18.454079 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Roles: reader,member Jun 07 08:50:18.455738 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0899cad1b7c64a0199b3466d4c7cfefb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0899cad1b7c64a0199b3466d4c7cfefb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0899cad1b7c64a0199b3466d4c7cfefb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0899cad1b7c64a0199b3466d4c7cfefb"}]}] Jun 07 08:50:18.455738 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:50:18.455738 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Id: 0899cad1b7c64a0199b3466d4c7cfefb Jun 07 08:50:18.455738 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:50:18.455738 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User: tempest-AttachVolumeNegativeTest-1278776647-project Jun 07 08:50:18.455738 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Id: default Jun 07 08:50:18.455738 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Name: Default Jun 07 08:50:18.455738 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Id: 52ddf59fe764404eb1c6ee745e21d352 Jun 07 08:50:18.455738 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Name: tempest-AttachVolumeNegativeTest-1278776647-project Jun 07 08:50:18.455738 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: method: > Jun 07 08:50:18.455738 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: exception: Instance 08308b76-0df7-4c43-a434-6880034a8c54 could not be found. Jun 07 08:50:18.455738 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: action_args: {'id': '08308b76-0df7-4c43-a434-6880034a8c54'} Jun 07 08:50:18.456558 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:50:18.456558 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:50:18.456558 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:50:18.456558 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:50:18.456558 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:50:18.456558 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:50:18.456558 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:50:18.456558 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:50:18.456558 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:50:18.456558 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:50:18.456558 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08308b76-0df7-4c43-a434-6880034a8c54 could not be found. Jun 07 08:50:18.456558 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:50:18.456558 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:50:18.456558 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:50:18.456558 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:50:18.456558 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:50:18.456558 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:50:18.456558 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:50:18.456558 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:50:18.456558 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:50:18.457838 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:50:18.457838 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 08:50:18.457838 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 08:50:18.457838 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:50:18.457838 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:50:18.457838 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:50:18.457838 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:50:18.457838 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08308b76-0df7-4c43-a434-6880034a8c54 could not be found. Jun 07 08:50:18.457838 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:50:18.457838 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:50:18.457838 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:50:18.457838 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:50:18.457838 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:50:18.457838 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:50:18.457838 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:50:18.457838 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:50:18.457838 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08308b76-0df7-4c43-a434-6880034a8c54 could not be found. Jun 07 08:50:18.457838 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:50:18.458954 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-a5d688d9-d899-4e6f-a6c5-36236fee68ee tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Returning 404 to user: Instance 08308b76-0df7-4c43-a434-6880034a8c54 could not be found. {{(pid=129726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:50:18.458954 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-a5d688d9-d899-4e6f-a6c5-36236fee68ee tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54" status: 404 len: 111 microversion: 2.1 time: 0.029851 Jun 07 08:50:18.458954 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 515/1035] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:50:18 2022] GET /compute/v2.1/servers/08308b76-0df7-4c43-a434-6880034a8c54 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:50:18.464284 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-55b2e03e-e811-4542-b7fc-b9bd0b2f8144 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:50:18.467110 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-55b2e03e-e811-4542-b7fc-b9bd0b2f8144 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:50:18.471757 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-55b2e03e-e811-4542-b7fc-b9bd0b2f8144 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:18.472214 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-55b2e03e-e811-4542-b7fc-b9bd0b2f8144 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:18.473032 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-55b2e03e-e811-4542-b7fc-b9bd0b2f8144 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:18.473598 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-55b2e03e-e811-4542-b7fc-b9bd0b2f8144 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:18.488230 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.wsgi [None req-55b2e03e-e811-4542-b7fc-b9bd0b2f8144 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] HTTP exception thrown: Instance c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 could not be found. Jun 07 08:50:18.489876 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-55b2e03e-e811-4542-b7fc-b9bd0b2f8144 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Request method failure captured: Jun 07 08:50:18.489876 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: request: DELETE /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 HTTP/1.1 Jun 07 08:50:18.489876 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept: application/json Jun 07 08:50:18.489876 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept-Encoding: identity Jun 07 08:50:18.489876 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Connection: close Jun 07 08:50:18.489876 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Length: 0 Jun 07 08:50:18.489876 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Type: application/json Jun 07 08:50:18.489876 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Host: 10.222.0.17 Jun 07 08:50:18.489876 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Openstack-System-Scope: None Jun 07 08:50:18.489876 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: User-Agent: python-urllib3/1.26.9 Jun 07 08:50:18.489876 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Auth-Token: gAAAAABinxAgj5C7ouE1N-aaB4GYPlt92HgnY7l_4qNjeb7MhcXewkqTDq3SwhJjBOupqPwAwi-EUO3Doxu5eOmMdEwFCWQlkuqeuPwgDsRWAIP7QSDJjzl4qrePMCoCSyDT0Sg0QJjM04PVEJfbaffcjJA3z-4CjpQwrMDzvrui6SNaABiQiRQ Jun 07 08:50:18.489876 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Id: None Jun 07 08:50:18.489876 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Name: None Jun 07 08:50:18.489876 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Identity-Status: Confirmed Jun 07 08:50:18.489876 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Is-Admin-Project: True Jun 07 08:50:18.489876 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Id: default Jun 07 08:50:18.489876 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Name: Default Jun 07 08:50:18.489876 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Id: 0899cad1b7c64a0199b3466d4c7cfefb Jun 07 08:50:18.489876 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Name: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:50:18.489876 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Role: reader,member Jun 07 08:50:18.489876 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Roles: reader,member Jun 07 08:50:18.491465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0899cad1b7c64a0199b3466d4c7cfefb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0899cad1b7c64a0199b3466d4c7cfefb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0899cad1b7c64a0199b3466d4c7cfefb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0899cad1b7c64a0199b3466d4c7cfefb"}]}] Jun 07 08:50:18.491465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:50:18.491465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Id: 0899cad1b7c64a0199b3466d4c7cfefb Jun 07 08:50:18.491465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:50:18.491465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User: tempest-AttachVolumeNegativeTest-1278776647-project Jun 07 08:50:18.491465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Id: default Jun 07 08:50:18.491465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Name: Default Jun 07 08:50:18.491465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Id: 52ddf59fe764404eb1c6ee745e21d352 Jun 07 08:50:18.491465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Name: tempest-AttachVolumeNegativeTest-1278776647-project Jun 07 08:50:18.491465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: method: > Jun 07 08:50:18.491465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: exception: Instance c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 could not be found. Jun 07 08:50:18.491465 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: action_args: {'id': 'c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1'} Jun 07 08:50:18.492379 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:50:18.492379 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:50:18.492379 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:50:18.492379 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:50:18.492379 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:50:18.492379 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:50:18.492379 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:50:18.492379 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:50:18.492379 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:50:18.492379 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:50:18.492379 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 could not be found. Jun 07 08:50:18.492379 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:50:18.492379 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:50:18.492379 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:50:18.492379 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:50:18.492379 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:50:18.492379 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:50:18.492379 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:50:18.492379 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:50:18.492379 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:50:18.494088 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:50:18.494088 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 08:50:18.494088 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 08:50:18.494088 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 08:50:18.494088 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 08:50:18.494088 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:50:18.494088 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:50:18.494088 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:50:18.494088 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:50:18.494088 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 could not be found. Jun 07 08:50:18.494088 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:50:18.494088 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:50:18.494088 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:50:18.494088 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:50:18.494088 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:50:18.494088 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:50:18.494088 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:50:18.494088 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:50:18.494088 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 could not be found. Jun 07 08:50:18.494088 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:50:18.495645 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-55b2e03e-e811-4542-b7fc-b9bd0b2f8144 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Returning 404 to user: Instance c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 could not be found. {{(pid=129725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:50:18.495645 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-55b2e03e-e811-4542-b7fc-b9bd0b2f8144 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1" status: 404 len: 111 microversion: 2.1 time: 0.031108 Jun 07 08:50:18.495645 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 521/1036] 10.222.0.17 () {58 vars in 1238 bytes} [Tue Jun 7 08:50:18 2022] DELETE /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:50:18.499966 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-48ba9b6e-4528-4569-8529-772a29e44237 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:50:18.500583 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-48ba9b6e-4528-4569-8529-772a29e44237 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:50:18.507587 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-48ba9b6e-4528-4569-8529-772a29e44237 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:18.508035 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-48ba9b6e-4528-4569-8529-772a29e44237 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:18.508806 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-48ba9b6e-4528-4569-8529-772a29e44237 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:18.509273 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-48ba9b6e-4528-4569-8529-772a29e44237 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:18.523670 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.wsgi [None req-48ba9b6e-4528-4569-8529-772a29e44237 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] HTTP exception thrown: Instance c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 could not be found. Jun 07 08:50:18.525493 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-48ba9b6e-4528-4569-8529-772a29e44237 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Request method failure captured: Jun 07 08:50:18.525493 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: request: GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 HTTP/1.1 Jun 07 08:50:18.525493 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept: application/json Jun 07 08:50:18.525493 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept-Encoding: identity Jun 07 08:50:18.525493 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Connection: close Jun 07 08:50:18.525493 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Length: 0 Jun 07 08:50:18.525493 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Type: application/json Jun 07 08:50:18.525493 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Host: 10.222.0.17 Jun 07 08:50:18.525493 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Openstack-System-Scope: None Jun 07 08:50:18.525493 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: User-Agent: python-urllib3/1.26.9 Jun 07 08:50:18.525493 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Auth-Token: gAAAAABinxAgj5C7ouE1N-aaB4GYPlt92HgnY7l_4qNjeb7MhcXewkqTDq3SwhJjBOupqPwAwi-EUO3Doxu5eOmMdEwFCWQlkuqeuPwgDsRWAIP7QSDJjzl4qrePMCoCSyDT0Sg0QJjM04PVEJfbaffcjJA3z-4CjpQwrMDzvrui6SNaABiQiRQ Jun 07 08:50:18.525493 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Id: None Jun 07 08:50:18.525493 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Name: None Jun 07 08:50:18.525493 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Identity-Status: Confirmed Jun 07 08:50:18.525493 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Is-Admin-Project: True Jun 07 08:50:18.525493 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Id: default Jun 07 08:50:18.525493 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Name: Default Jun 07 08:50:18.525493 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Id: 0899cad1b7c64a0199b3466d4c7cfefb Jun 07 08:50:18.525493 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:50:18.525493 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Role: reader,member Jun 07 08:50:18.525493 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Roles: reader,member Jun 07 08:50:18.527125 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0899cad1b7c64a0199b3466d4c7cfefb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0899cad1b7c64a0199b3466d4c7cfefb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0899cad1b7c64a0199b3466d4c7cfefb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0899cad1b7c64a0199b3466d4c7cfefb"}]}] Jun 07 08:50:18.527125 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:50:18.527125 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Id: 0899cad1b7c64a0199b3466d4c7cfefb Jun 07 08:50:18.527125 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:50:18.527125 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User: tempest-AttachVolumeNegativeTest-1278776647-project Jun 07 08:50:18.527125 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Id: default Jun 07 08:50:18.527125 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Name: Default Jun 07 08:50:18.527125 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Id: 52ddf59fe764404eb1c6ee745e21d352 Jun 07 08:50:18.527125 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Name: tempest-AttachVolumeNegativeTest-1278776647-project Jun 07 08:50:18.527125 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: method: > Jun 07 08:50:18.527125 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: exception: Instance c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 could not be found. Jun 07 08:50:18.527125 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: action_args: {'id': 'c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1'} Jun 07 08:50:18.527943 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:50:18.527943 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:50:18.527943 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:50:18.527943 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:50:18.527943 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:50:18.527943 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:50:18.527943 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:50:18.527943 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:50:18.527943 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:50:18.527943 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:50:18.527943 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 could not be found. Jun 07 08:50:18.527943 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:50:18.527943 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:50:18.527943 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:50:18.527943 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:50:18.527943 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:50:18.527943 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:50:18.527943 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:50:18.527943 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:50:18.527943 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:50:18.529206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:50:18.529206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 08:50:18.529206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 08:50:18.529206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:50:18.529206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:50:18.529206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:50:18.529206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:50:18.529206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 could not be found. Jun 07 08:50:18.529206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:50:18.529206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:50:18.529206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:50:18.529206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:50:18.529206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:50:18.529206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:50:18.529206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:50:18.529206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:50:18.529206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 could not be found. Jun 07 08:50:18.529206 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:50:18.530349 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-48ba9b6e-4528-4569-8529-772a29e44237 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Returning 404 to user: Instance c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 could not be found. {{(pid=129726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:50:18.530349 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-48ba9b6e-4528-4569-8529-772a29e44237 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1" status: 404 len: 111 microversion: 2.1 time: 0.030764 Jun 07 08:50:18.530349 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 516/1037] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:50:18 2022] GET /compute/v2.1/servers/c4f6e0cb-e4e6-4bca-a3a0-e8fa1b3642f1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 07 08:50:20.022785 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-e442cef9-e7ba-4d65-97eb-8d9026e8b948 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:50:20.023278 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-e442cef9-e7ba-4d65-97eb-8d9026e8b948 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:50:20.029926 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e442cef9-e7ba-4d65-97eb-8d9026e8b948 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:20.030378 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e442cef9-e7ba-4d65-97eb-8d9026e8b948 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:20.031132 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e442cef9-e7ba-4d65-97eb-8d9026e8b948 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:20.031562 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e442cef9-e7ba-4d65-97eb-8d9026e8b948 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:20.045350 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.wsgi [None req-e442cef9-e7ba-4d65-97eb-8d9026e8b948 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] HTTP exception thrown: Instance a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 could not be found. Jun 07 08:50:20.046858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-e442cef9-e7ba-4d65-97eb-8d9026e8b948 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Request method failure captured: Jun 07 08:50:20.046858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: request: DELETE /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 HTTP/1.1 Jun 07 08:50:20.046858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept: application/json Jun 07 08:50:20.046858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept-Encoding: identity Jun 07 08:50:20.046858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Connection: close Jun 07 08:50:20.046858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Length: 0 Jun 07 08:50:20.046858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Type: application/json Jun 07 08:50:20.046858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Host: 10.222.0.17 Jun 07 08:50:20.046858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Openstack-System-Scope: None Jun 07 08:50:20.046858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: User-Agent: python-urllib3/1.26.9 Jun 07 08:50:20.046858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Auth-Token: gAAAAABinxAgj5C7ouE1N-aaB4GYPlt92HgnY7l_4qNjeb7MhcXewkqTDq3SwhJjBOupqPwAwi-EUO3Doxu5eOmMdEwFCWQlkuqeuPwgDsRWAIP7QSDJjzl4qrePMCoCSyDT0Sg0QJjM04PVEJfbaffcjJA3z-4CjpQwrMDzvrui6SNaABiQiRQ Jun 07 08:50:20.046858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Id: None Jun 07 08:50:20.046858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Name: None Jun 07 08:50:20.046858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Identity-Status: Confirmed Jun 07 08:50:20.046858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Is-Admin-Project: True Jun 07 08:50:20.046858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Id: default Jun 07 08:50:20.046858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Name: Default Jun 07 08:50:20.046858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Id: 0899cad1b7c64a0199b3466d4c7cfefb Jun 07 08:50:20.046858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Name: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:50:20.046858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Role: reader,member Jun 07 08:50:20.046858 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Roles: reader,member Jun 07 08:50:20.049065 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0899cad1b7c64a0199b3466d4c7cfefb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0899cad1b7c64a0199b3466d4c7cfefb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0899cad1b7c64a0199b3466d4c7cfefb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0899cad1b7c64a0199b3466d4c7cfefb"}]}] Jun 07 08:50:20.049065 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:50:20.049065 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Id: 0899cad1b7c64a0199b3466d4c7cfefb Jun 07 08:50:20.049065 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:50:20.049065 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User: tempest-AttachVolumeNegativeTest-1278776647-project Jun 07 08:50:20.049065 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Id: default Jun 07 08:50:20.049065 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Name: Default Jun 07 08:50:20.049065 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Id: 52ddf59fe764404eb1c6ee745e21d352 Jun 07 08:50:20.049065 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Name: tempest-AttachVolumeNegativeTest-1278776647-project Jun 07 08:50:20.049065 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: method: > Jun 07 08:50:20.049065 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: exception: Instance a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 could not be found. Jun 07 08:50:20.049065 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: action_args: {'id': 'a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22'} Jun 07 08:50:20.050052 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:50:20.050052 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:50:20.050052 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:50:20.050052 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:50:20.050052 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:50:20.050052 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:50:20.050052 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:50:20.050052 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:50:20.050052 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:50:20.050052 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:50:20.050052 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 could not be found. Jun 07 08:50:20.050052 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:50:20.050052 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:50:20.050052 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:50:20.050052 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:50:20.050052 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:50:20.050052 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:50:20.050052 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:50:20.050052 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:50:20.050052 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:50:20.051621 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:50:20.051621 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 08:50:20.051621 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 08:50:20.051621 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 08:50:20.051621 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 08:50:20.051621 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:50:20.051621 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:50:20.051621 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:50:20.051621 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:50:20.051621 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 could not be found. Jun 07 08:50:20.051621 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:50:20.051621 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:50:20.051621 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:50:20.051621 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:50:20.051621 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:50:20.051621 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:50:20.051621 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:50:20.051621 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:50:20.051621 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 could not be found. Jun 07 08:50:20.051621 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:50:20.053233 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-e442cef9-e7ba-4d65-97eb-8d9026e8b948 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Returning 404 to user: Instance a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 could not be found. {{(pid=129725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:50:20.053233 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-e442cef9-e7ba-4d65-97eb-8d9026e8b948 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22" status: 404 len: 111 microversion: 2.1 time: 0.029898 Jun 07 08:50:20.053233 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 522/1038] 10.222.0.17 () {58 vars in 1238 bytes} [Tue Jun 7 08:50:20 2022] DELETE /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:50:20.057269 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-1f5e1104-611e-40f2-836b-99a33d5fc1f7 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:50:20.057888 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-1f5e1104-611e-40f2-836b-99a33d5fc1f7 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] [instance: a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:50:20.064342 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1f5e1104-611e-40f2-836b-99a33d5fc1f7 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:20.064800 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1f5e1104-611e-40f2-836b-99a33d5fc1f7 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:20.065605 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1f5e1104-611e-40f2-836b-99a33d5fc1f7 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:50:20.066055 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-1f5e1104-611e-40f2-836b-99a33d5fc1f7 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:50:20.079456 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.wsgi [None req-1f5e1104-611e-40f2-836b-99a33d5fc1f7 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] HTTP exception thrown: Instance a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 could not be found. Jun 07 08:50:20.080982 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-1f5e1104-611e-40f2-836b-99a33d5fc1f7 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Request method failure captured: Jun 07 08:50:20.080982 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: request: GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 HTTP/1.1 Jun 07 08:50:20.080982 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept: application/json Jun 07 08:50:20.080982 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept-Encoding: identity Jun 07 08:50:20.080982 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Connection: close Jun 07 08:50:20.080982 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Length: 0 Jun 07 08:50:20.080982 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Type: application/json Jun 07 08:50:20.080982 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Host: 10.222.0.17 Jun 07 08:50:20.080982 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Openstack-System-Scope: None Jun 07 08:50:20.080982 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: User-Agent: python-urllib3/1.26.9 Jun 07 08:50:20.080982 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Auth-Token: gAAAAABinxAgj5C7ouE1N-aaB4GYPlt92HgnY7l_4qNjeb7MhcXewkqTDq3SwhJjBOupqPwAwi-EUO3Doxu5eOmMdEwFCWQlkuqeuPwgDsRWAIP7QSDJjzl4qrePMCoCSyDT0Sg0QJjM04PVEJfbaffcjJA3z-4CjpQwrMDzvrui6SNaABiQiRQ Jun 07 08:50:20.080982 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Id: None Jun 07 08:50:20.080982 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Name: None Jun 07 08:50:20.080982 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Identity-Status: Confirmed Jun 07 08:50:20.080982 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Is-Admin-Project: True Jun 07 08:50:20.080982 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Id: default Jun 07 08:50:20.080982 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Name: Default Jun 07 08:50:20.080982 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Id: 0899cad1b7c64a0199b3466d4c7cfefb Jun 07 08:50:20.080982 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Name: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:50:20.080982 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Role: reader,member Jun 07 08:50:20.080982 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Roles: reader,member Jun 07 08:50:20.082660 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0899cad1b7c64a0199b3466d4c7cfefb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0899cad1b7c64a0199b3466d4c7cfefb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0899cad1b7c64a0199b3466d4c7cfefb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0899cad1b7c64a0199b3466d4c7cfefb"}]}] Jun 07 08:50:20.082660 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:50:20.082660 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Id: 0899cad1b7c64a0199b3466d4c7cfefb Jun 07 08:50:20.082660 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1278776647 Jun 07 08:50:20.082660 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User: tempest-AttachVolumeNegativeTest-1278776647-project Jun 07 08:50:20.082660 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Id: default Jun 07 08:50:20.082660 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Name: Default Jun 07 08:50:20.082660 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Id: 52ddf59fe764404eb1c6ee745e21d352 Jun 07 08:50:20.082660 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Name: tempest-AttachVolumeNegativeTest-1278776647-project Jun 07 08:50:20.082660 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: method: > Jun 07 08:50:20.082660 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: exception: Instance a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 could not be found. Jun 07 08:50:20.082660 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: action_args: {'id': 'a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22'} Jun 07 08:50:20.083715 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:50:20.083715 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:50:20.083715 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:50:20.083715 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:50:20.083715 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:50:20.083715 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:50:20.083715 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:50:20.083715 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:50:20.083715 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:50:20.083715 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:50:20.083715 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 could not be found. Jun 07 08:50:20.083715 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:50:20.083715 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:50:20.083715 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:50:20.083715 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:50:20.083715 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:50:20.083715 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:50:20.083715 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:50:20.083715 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:50:20.083715 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:50:20.085260 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:50:20.085260 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 08:50:20.085260 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 08:50:20.085260 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:50:20.085260 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:50:20.085260 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:50:20.085260 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:50:20.085260 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 could not be found. Jun 07 08:50:20.085260 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:50:20.085260 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:50:20.085260 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:50:20.085260 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:50:20.085260 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:50:20.085260 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:50:20.085260 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:50:20.085260 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:50:20.085260 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 could not be found. Jun 07 08:50:20.085260 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:50:20.086857 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-1f5e1104-611e-40f2-836b-99a33d5fc1f7 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] Returning 404 to user: Instance a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 could not be found. {{(pid=129726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:50:20.086857 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-1f5e1104-611e-40f2-836b-99a33d5fc1f7 tempest-AttachVolumeNegativeTest-1278776647 tempest-AttachVolumeNegativeTest-1278776647-project] 10.222.0.17 "GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22" status: 404 len: 111 microversion: 2.1 time: 0.028951 Jun 07 08:50:20.086857 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 517/1039] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:50:20 2022] GET /compute/v2.1/servers/a9aee70d-b7c5-4f29-a2eb-bc6f5c435a22 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:51:18.506324 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:51:18.507239 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:51:18.870004 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-1f6a0d04-040a-4689-a95a-28036b6c7329 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Action: 'create', calling method: .version_select at 0x7f7fedd49310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-996397736", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrTYVDmb1CI3TORpimYkk1WLzBw3fLVSsxv+1KnWHpX3WAWkylH5NbHWb91e7s4w6ZmJZysWfzGwBRXd7tUoqMt1cKSBbk8cIvCwAMzTabGSDaPUH8k/IdRf0bj7rFBfQ=="}} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:51:18.893702 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.quota [None req-1f6a0d04-040a-4689-a95a-28036b6c7329 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Getting quotas for project af50419d91204a8eb8c1dca13803aa2f. Resources: {'key_pairs'} {{(pid=129725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 08:51:18.898796 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.quota [None req-1f6a0d04-040a-4689-a95a-28036b6c7329 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Getting quotas for user 55abc5e9e3a24da9abae9a2c44466b8f and project af50419d91204a8eb8c1dca13803aa2f. Resources: {'key_pairs'} {{(pid=129725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 08:51:18.913587 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1f6a0d04-040a-4689-a95a-28036b6c7329 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [e5a85979-e112-4267-a9ec-494a4a5585b0] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 07 08:51:19.920975 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO oslo.messaging._drivers.impl_rabbit [None req-1f6a0d04-040a-4689-a95a-28036b6c7329 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [e5a85979-e112-4267-a9ec-494a4a5585b0] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 53942. Jun 07 08:51:19.990009 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-1f6a0d04-040a-4689-a95a-28036b6c7329 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 1.489225 Jun 07 08:51:19.990627 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 523/1040] 10.222.0.17 () {60 vars in 1158 bytes} [Tue Jun 7 08:51:18 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:51:34.384483 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 08:51:34.385244 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Tue Jun 7 08:51:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 08:51:40.378217 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-2ef4239e-9a7f-46e0-84cf-e67789d023a2 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1629253896", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-996397736", "security_groups": [{"name": "tempest-secgroup-smoke-325903687"}], "block_device_mapping_v2": [{"uuid": "85e3ccd1-209a-4d4f-a9a1-a8ff0b2aece4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "807de0cf-4a8a-45df-b7af-2f900ed52dc0"}]}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:51:40.387502 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:51:40.388160 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:51:40.490759 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.network.neutron [None req-2ef4239e-9a7f-46e0-84cf-e67789d023a2 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] validate_networks() for [('807de0cf-4a8a-45df-b7af-2f900ed52dc0', None, None, None, None, None)] {{(pid=129726) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 08:51:40.940394 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-2ef4239e-9a7f-46e0-84cf-e67789d023a2 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Flavor limits 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 08:51:40.940814 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-2ef4239e-9a7f-46e0-84cf-e67789d023a2 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Image limits 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 08:51:40.941319 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-2ef4239e-9a7f-46e0-84cf-e67789d023a2 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Flavor pref 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 08:51:40.941810 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-2ef4239e-9a7f-46e0-84cf-e67789d023a2 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Image pref 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 08:51:40.942229 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-2ef4239e-9a7f-46e0-84cf-e67789d023a2 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 08:51:40.951836 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2ef4239e-9a7f-46e0-84cf-e67789d023a2 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:51:40.952289 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2ef4239e-9a7f-46e0-84cf-e67789d023a2 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:51:40.953111 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2ef4239e-9a7f-46e0-84cf-e67789d023a2 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:51:40.953545 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2ef4239e-9a7f-46e0-84cf-e67789d023a2 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:51:40.970200 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-2ef4239e-9a7f-46e0-84cf-e67789d023a2 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Getting quotas for project af50419d91204a8eb8c1dca13803aa2f. Resources: {'ram', 'cores', 'instances'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 08:51:40.974617 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-2ef4239e-9a7f-46e0-84cf-e67789d023a2 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Getting quotas for user 55abc5e9e3a24da9abae9a2c44466b8f and project af50419d91204a8eb8c1dca13803aa2f. Resources: {'ram', 'cores', 'instances'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 08:51:41.031069 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-2ef4239e-9a7f-46e0-84cf-e67789d023a2 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Going to run 1 instances... {{(pid=129726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 08:51:41.033198 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-2ef4239e-9a7f-46e0-84cf-e67789d023a2 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 1cf010ae-3b1c-4424-93a1-909556809cd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='85e3ccd1-209a-4d4f-a9a1-a8ff0b2aece4',volume_size=None,volume_type=None)] {{(pid=129726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 08:51:41.438140 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2ef4239e-9a7f-46e0-84cf-e67789d023a2 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [d5485d84-a5ac-46e8-987d-ca382407e9d6] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 07 08:51:42.445536 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO oslo.messaging._drivers.impl_rabbit [None req-2ef4239e-9a7f-46e0-84cf-e67789d023a2 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [d5485d84-a5ac-46e8-987d-ca382407e9d6] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 54092. Jun 07 08:51:42.449459 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-2ef4239e-9a7f-46e0-84cf-e67789d023a2 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.075940 Jun 07 08:51:42.450107 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 518/1041] 10.222.0.17 () {60 vars in 1146 bytes} [Tue Jun 7 08:51:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 2077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 08:51:42.460284 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-d76b2e57-1542-4230-a01e-0ec5cb7e0406 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:51:42.461170 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-d76b2e57-1542-4230-a01e-0ec5cb7e0406 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 1cf010ae-3b1c-4424-93a1-909556809cd9] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:51:42.467982 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell0:SELECT=4 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:51:42.469851 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:51:42.522435 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-d76b2e57-1542-4230-a01e-0ec5cb7e0406 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:51:42.529694 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-d76b2e57-1542-4230-a01e-0ec5cb7e0406 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9" status: 200 len: 1094 microversion: 2.1 time: 0.073564 Jun 07 08:51:42.530268 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 524/1042] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:51:42 2022] GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9 => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:51:43.548142 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-0457d5d1-6dee-45b9-b8fe-56fadc7c716e tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:51:43.548755 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-0457d5d1-6dee-45b9-b8fe-56fadc7c716e tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 1cf010ae-3b1c-4424-93a1-909556809cd9] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:51:43.556531 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0457d5d1-6dee-45b9-b8fe-56fadc7c716e tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:51:43.556983 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0457d5d1-6dee-45b9-b8fe-56fadc7c716e tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:51:43.557919 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0457d5d1-6dee-45b9-b8fe-56fadc7c716e tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:51:43.558578 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-0457d5d1-6dee-45b9-b8fe-56fadc7c716e tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:51:43.620017 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-0457d5d1-6dee-45b9-b8fe-56fadc7c716e tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:51:43.627469 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-0457d5d1-6dee-45b9-b8fe-56fadc7c716e tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9" status: 200 len: 1144 microversion: 2.1 time: 0.084465 Jun 07 08:51:43.632046 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 519/1043] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:51:43 2022] GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9 => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:51:44.644829 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-d73fce78-0f77-4870-8294-a78a5704d94b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:51:44.645496 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-d73fce78-0f77-4870-8294-a78a5704d94b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 1cf010ae-3b1c-4424-93a1-909556809cd9] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:51:44.654576 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d73fce78-0f77-4870-8294-a78a5704d94b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:51:44.660470 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d73fce78-0f77-4870-8294-a78a5704d94b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:51:44.660470 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d73fce78-0f77-4870-8294-a78a5704d94b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:51:44.660470 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-d73fce78-0f77-4870-8294-a78a5704d94b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:51:44.752799 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-d73fce78-0f77-4870-8294-a78a5704d94b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:51:44.760889 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-d73fce78-0f77-4870-8294-a78a5704d94b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9" status: 200 len: 1200 microversion: 2.1 time: 0.119909 Jun 07 08:51:44.761490 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 525/1044] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:51:44 2022] GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9 => generated 1200 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:51:45.778105 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-589a8b40-fb33-4cfe-a56b-d15b0c3183ed tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:51:45.778835 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-589a8b40-fb33-4cfe-a56b-d15b0c3183ed tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 1cf010ae-3b1c-4424-93a1-909556809cd9] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:51:45.785248 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-589a8b40-fb33-4cfe-a56b-d15b0c3183ed tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:51:45.785700 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-589a8b40-fb33-4cfe-a56b-d15b0c3183ed tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:51:45.787034 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-589a8b40-fb33-4cfe-a56b-d15b0c3183ed tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:51:45.787470 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-589a8b40-fb33-4cfe-a56b-d15b0c3183ed tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:51:45.926970 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-589a8b40-fb33-4cfe-a56b-d15b0c3183ed tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:51:45.934612 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-589a8b40-fb33-4cfe-a56b-d15b0c3183ed tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9" status: 200 len: 1277 microversion: 2.1 time: 0.160632 Jun 07 08:51:45.935182 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 520/1045] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:51:45 2022] GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9 => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:51:46.347179 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-e117bb57-3da9-4476-86e4-bf6ce2e20056 req-a01d0727-11f5-4103-a0f3-de00270c33b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cf010ae-3b1c-4424-93a1-909556809cd9", "tag": "36a00b70-8f30-434a-8856-2a4e360e4631"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:51:46.359761 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-e117bb57-3da9-4476-86e4-bf6ce2e20056 req-a01d0727-11f5-4103-a0f3-de00270c33b1 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:51:46.359761 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-e117bb57-3da9-4476-86e4-bf6ce2e20056 req-a01d0727-11f5-4103-a0f3-de00270c33b1 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:51:46.371327 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-e117bb57-3da9-4476-86e4-bf6ce2e20056 req-a01d0727-11f5-4103-a0f3-de00270c33b1 service nova] Creating event network-changed:36a00b70-8f30-434a-8856-2a4e360e4631 for instance 1cf010ae-3b1c-4424-93a1-909556809cd9 on hv-cinder-74014 Jun 07 08:51:46.376629 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-e117bb57-3da9-4476-86e4-bf6ce2e20056 req-a01d0727-11f5-4103-a0f3-de00270c33b1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033142 Jun 07 08:51:46.377250 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 526/1046] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:51:46.952295 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-6956afb1-7940-421d-8797-52d72184caf1 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:51:46.952918 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-6956afb1-7940-421d-8797-52d72184caf1 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 1cf010ae-3b1c-4424-93a1-909556809cd9] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:51:46.959125 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6956afb1-7940-421d-8797-52d72184caf1 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:51:46.959576 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6956afb1-7940-421d-8797-52d72184caf1 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:51:46.960339 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6956afb1-7940-421d-8797-52d72184caf1 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:51:46.960781 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-6956afb1-7940-421d-8797-52d72184caf1 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:51:47.091258 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-6956afb1-7940-421d-8797-52d72184caf1 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:51:47.099473 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-6956afb1-7940-421d-8797-52d72184caf1 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9" status: 200 len: 1265 microversion: 2.1 time: 0.150489 Jun 07 08:51:47.100046 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 521/1047] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:51:46 2022] GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:51:48.118686 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-02e8261c-e5d0-412c-91f2-2d442cf37c4c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:51:48.119390 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-02e8261c-e5d0-412c-91f2-2d442cf37c4c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 1cf010ae-3b1c-4424-93a1-909556809cd9] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:51:48.125884 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-02e8261c-e5d0-412c-91f2-2d442cf37c4c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:51:48.131586 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-02e8261c-e5d0-412c-91f2-2d442cf37c4c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:51:48.131586 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-02e8261c-e5d0-412c-91f2-2d442cf37c4c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:51:48.131586 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-02e8261c-e5d0-412c-91f2-2d442cf37c4c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:51:48.263063 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-02e8261c-e5d0-412c-91f2-2d442cf37c4c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:51:48.270898 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-02e8261c-e5d0-412c-91f2-2d442cf37c4c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9" status: 200 len: 1265 microversion: 2.1 time: 0.157363 Jun 07 08:51:48.271551 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 527/1048] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:51:48 2022] GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:51:49.288171 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-068e9df6-9060-4442-a673-ca0963348948 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:51:49.288793 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-068e9df6-9060-4442-a673-ca0963348948 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 1cf010ae-3b1c-4424-93a1-909556809cd9] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:51:49.295388 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-068e9df6-9060-4442-a673-ca0963348948 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:51:49.295839 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-068e9df6-9060-4442-a673-ca0963348948 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:51:49.296605 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-068e9df6-9060-4442-a673-ca0963348948 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:51:49.297076 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-068e9df6-9060-4442-a673-ca0963348948 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:51:49.428507 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-068e9df6-9060-4442-a673-ca0963348948 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:51:49.436257 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-068e9df6-9060-4442-a673-ca0963348948 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9" status: 200 len: 1265 microversion: 2.1 time: 0.151914 Jun 07 08:51:49.436832 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 522/1049] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:51:49 2022] GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:51:50.453351 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-505e9d15-768a-4edc-bf5b-6072f87b3c08 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:51:50.453881 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-505e9d15-768a-4edc-bf5b-6072f87b3c08 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 1cf010ae-3b1c-4424-93a1-909556809cd9] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:51:50.460976 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-505e9d15-768a-4edc-bf5b-6072f87b3c08 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:51:50.461459 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-505e9d15-768a-4edc-bf5b-6072f87b3c08 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:51:50.462226 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-505e9d15-768a-4edc-bf5b-6072f87b3c08 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:51:50.462667 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-505e9d15-768a-4edc-bf5b-6072f87b3c08 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:51:50.592001 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-505e9d15-768a-4edc-bf5b-6072f87b3c08 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:51:50.599533 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-505e9d15-768a-4edc-bf5b-6072f87b3c08 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9" status: 200 len: 1265 microversion: 2.1 time: 0.150168 Jun 07 08:51:50.600100 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 528/1050] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:51:50 2022] GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:51:51.616303 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-c14ed4cd-226a-4d77-ae53-2d25e5bbadc7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:51:51.616977 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-c14ed4cd-226a-4d77-ae53-2d25e5bbadc7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 1cf010ae-3b1c-4424-93a1-909556809cd9] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:51:51.619333 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell0:SELECT=2 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:51:51.620003 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell0:SELECT=6 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:51:51.624821 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c14ed4cd-226a-4d77-ae53-2d25e5bbadc7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:51:51.625311 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c14ed4cd-226a-4d77-ae53-2d25e5bbadc7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:51:51.626075 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c14ed4cd-226a-4d77-ae53-2d25e5bbadc7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:51:51.626515 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c14ed4cd-226a-4d77-ae53-2d25e5bbadc7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:51:51.755969 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-c14ed4cd-226a-4d77-ae53-2d25e5bbadc7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:51:51.763973 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-c14ed4cd-226a-4d77-ae53-2d25e5bbadc7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9" status: 200 len: 1265 microversion: 2.1 time: 0.151617 Jun 07 08:51:51.764532 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 523/1051] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:51:51 2022] GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:51:52.781708 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-3bf4d1b6-f9cb-4f40-9440-4f802a3bc5ae tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:51:52.782327 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-3bf4d1b6-f9cb-4f40-9440-4f802a3bc5ae tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 1cf010ae-3b1c-4424-93a1-909556809cd9] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:51:52.784847 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell0:SELECT=2 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:51:52.790307 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3bf4d1b6-f9cb-4f40-9440-4f802a3bc5ae tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:51:52.790758 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3bf4d1b6-f9cb-4f40-9440-4f802a3bc5ae tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:51:52.791527 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3bf4d1b6-f9cb-4f40-9440-4f802a3bc5ae tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:51:52.791967 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3bf4d1b6-f9cb-4f40-9440-4f802a3bc5ae tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:51:52.926580 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-3bf4d1b6-f9cb-4f40-9440-4f802a3bc5ae tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:51:52.934916 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-3bf4d1b6-f9cb-4f40-9440-4f802a3bc5ae tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9" status: 200 len: 1265 microversion: 2.1 time: 0.157051 Jun 07 08:51:52.935683 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 529/1052] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:51:52 2022] GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:51:53.951971 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-c67d1d35-5838-4d2e-b9da-65782d497639 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:51:53.952588 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-c67d1d35-5838-4d2e-b9da-65782d497639 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 1cf010ae-3b1c-4424-93a1-909556809cd9] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:51:53.958870 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c67d1d35-5838-4d2e-b9da-65782d497639 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:51:53.959322 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c67d1d35-5838-4d2e-b9da-65782d497639 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:51:53.960118 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c67d1d35-5838-4d2e-b9da-65782d497639 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:51:53.960555 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c67d1d35-5838-4d2e-b9da-65782d497639 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:51:54.095130 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-c67d1d35-5838-4d2e-b9da-65782d497639 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:51:54.102783 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-c67d1d35-5838-4d2e-b9da-65782d497639 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9" status: 200 len: 1265 microversion: 2.1 time: 0.154816 Jun 07 08:51:54.103289 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 524/1053] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:51:53 2022] GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:51:55.120134 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-7584a58d-a772-4c9e-9e7f-cf0ff0ed967a tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:51:55.120744 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-7584a58d-a772-4c9e-9e7f-cf0ff0ed967a tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 1cf010ae-3b1c-4424-93a1-909556809cd9] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:51:55.127107 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7584a58d-a772-4c9e-9e7f-cf0ff0ed967a tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:51:55.127554 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7584a58d-a772-4c9e-9e7f-cf0ff0ed967a tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:51:55.128322 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7584a58d-a772-4c9e-9e7f-cf0ff0ed967a tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:51:55.128760 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-7584a58d-a772-4c9e-9e7f-cf0ff0ed967a tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:51:55.262118 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-7584a58d-a772-4c9e-9e7f-cf0ff0ed967a tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:51:55.269749 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-7584a58d-a772-4c9e-9e7f-cf0ff0ed967a tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9" status: 200 len: 1265 microversion: 2.1 time: 0.153501 Jun 07 08:51:55.270318 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 530/1054] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:51:55 2022] GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:51:56.287056 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-04cfe22b-9e50-4d5c-a3ba-ddec7d315821 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:51:56.287666 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-04cfe22b-9e50-4d5c-a3ba-ddec7d315821 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 1cf010ae-3b1c-4424-93a1-909556809cd9] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:51:56.294720 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-04cfe22b-9e50-4d5c-a3ba-ddec7d315821 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:51:56.295275 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-04cfe22b-9e50-4d5c-a3ba-ddec7d315821 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:51:56.296061 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-04cfe22b-9e50-4d5c-a3ba-ddec7d315821 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:51:56.296505 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-04cfe22b-9e50-4d5c-a3ba-ddec7d315821 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:51:56.430946 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-04cfe22b-9e50-4d5c-a3ba-ddec7d315821 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:51:56.438485 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-04cfe22b-9e50-4d5c-a3ba-ddec7d315821 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9" status: 200 len: 1265 microversion: 2.1 time: 0.155359 Jun 07 08:51:56.439054 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 525/1055] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:51:56 2022] GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:51:57.455981 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-34e064be-c359-4de0-99e6-1452a32ea390 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:51:57.456568 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-34e064be-c359-4de0-99e6-1452a32ea390 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 1cf010ae-3b1c-4424-93a1-909556809cd9] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:51:57.463844 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-34e064be-c359-4de0-99e6-1452a32ea390 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:51:57.464291 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-34e064be-c359-4de0-99e6-1452a32ea390 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:51:57.465081 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-34e064be-c359-4de0-99e6-1452a32ea390 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:51:57.465518 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-34e064be-c359-4de0-99e6-1452a32ea390 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:51:57.605676 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-34e064be-c359-4de0-99e6-1452a32ea390 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:51:57.613361 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-34e064be-c359-4de0-99e6-1452a32ea390 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9" status: 200 len: 1265 microversion: 2.1 time: 0.161170 Jun 07 08:51:57.613933 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 531/1056] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:51:57 2022] GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:51:57.807151 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-2b703769-364a-4d0e-a99b-69e1fea87838 req-285f66a8-40d7-4985-a1c1-8d32286a082e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cf010ae-3b1c-4424-93a1-909556809cd9", "name": "network-vif-plugged", "status": "completed", "tag": "36a00b70-8f30-434a-8856-2a4e360e4631"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:51:57.815079 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-2b703769-364a-4d0e-a99b-69e1fea87838 req-285f66a8-40d7-4985-a1c1-8d32286a082e service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:51:57.815533 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-2b703769-364a-4d0e-a99b-69e1fea87838 req-285f66a8-40d7-4985-a1c1-8d32286a082e service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:51:57.826886 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-2b703769-364a-4d0e-a99b-69e1fea87838 req-285f66a8-40d7-4985-a1c1-8d32286a082e service nova] Creating event network-vif-plugged:36a00b70-8f30-434a-8856-2a4e360e4631 for instance 1cf010ae-3b1c-4424-93a1-909556809cd9 on hv-cinder-74014 Jun 07 08:51:57.831857 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-2b703769-364a-4d0e-a99b-69e1fea87838 req-285f66a8-40d7-4985-a1c1-8d32286a082e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087766 Jun 07 08:51:57.832449 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 526/1057] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:51:58.631062 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-67459bfc-27b5-4d40-aa1f-9966c4a97394 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:51:58.631609 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-67459bfc-27b5-4d40-aa1f-9966c4a97394 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 1cf010ae-3b1c-4424-93a1-909556809cd9] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:51:58.638066 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-67459bfc-27b5-4d40-aa1f-9966c4a97394 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:51:58.638510 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-67459bfc-27b5-4d40-aa1f-9966c4a97394 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:51:58.639266 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-67459bfc-27b5-4d40-aa1f-9966c4a97394 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:51:58.639722 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-67459bfc-27b5-4d40-aa1f-9966c4a97394 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:51:58.768874 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-67459bfc-27b5-4d40-aa1f-9966c4a97394 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:51:58.777096 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-67459bfc-27b5-4d40-aa1f-9966c4a97394 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9" status: 200 len: 1265 microversion: 2.1 time: 0.149970 Jun 07 08:51:58.777658 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 532/1058] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:51:58 2022] GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:51:59.798949 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-fbeb3cd0-98f0-465a-9b7a-e59b3e536dc7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:51:59.799644 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-fbeb3cd0-98f0-465a-9b7a-e59b3e536dc7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 1cf010ae-3b1c-4424-93a1-909556809cd9] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:51:59.806568 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fbeb3cd0-98f0-465a-9b7a-e59b3e536dc7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:51:59.807014 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fbeb3cd0-98f0-465a-9b7a-e59b3e536dc7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:51:59.807777 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fbeb3cd0-98f0-465a-9b7a-e59b3e536dc7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:51:59.808208 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fbeb3cd0-98f0-465a-9b7a-e59b3e536dc7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:51:59.945297 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-fbeb3cd0-98f0-465a-9b7a-e59b3e536dc7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:51:59.952855 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-fbeb3cd0-98f0-465a-9b7a-e59b3e536dc7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9" status: 200 len: 1265 microversion: 2.1 time: 0.158620 Jun 07 08:51:59.953448 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 527/1059] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:51:59 2022] GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:52:00.970654 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-b50d8d70-9db3-4ffa-a4af-1d204a2c1fe3 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:52:00.971261 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-b50d8d70-9db3-4ffa-a4af-1d204a2c1fe3 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 1cf010ae-3b1c-4424-93a1-909556809cd9] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:52:00.977925 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b50d8d70-9db3-4ffa-a4af-1d204a2c1fe3 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:52:00.978382 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b50d8d70-9db3-4ffa-a4af-1d204a2c1fe3 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:52:00.979156 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b50d8d70-9db3-4ffa-a4af-1d204a2c1fe3 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:52:00.979597 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-b50d8d70-9db3-4ffa-a4af-1d204a2c1fe3 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:52:01.110784 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-b50d8d70-9db3-4ffa-a4af-1d204a2c1fe3 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:52:01.118142 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-b50d8d70-9db3-4ffa-a4af-1d204a2c1fe3 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9" status: 200 len: 1452 microversion: 2.1 time: 0.152149 Jun 07 08:52:01.118824 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 533/1060] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:52:00 2022] GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9 => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:52:01.134545 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-25599067-a73a-40d3-ace4-f5bae9b5f444 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:52:01.135160 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-25599067-a73a-40d3-ace4-f5bae9b5f444 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 1cf010ae-3b1c-4424-93a1-909556809cd9] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:52:01.141671 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-25599067-a73a-40d3-ace4-f5bae9b5f444 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:52:01.142123 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-25599067-a73a-40d3-ace4-f5bae9b5f444 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:52:01.142886 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-25599067-a73a-40d3-ace4-f5bae9b5f444 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:52:01.143342 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-25599067-a73a-40d3-ace4-f5bae9b5f444 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:52:01.278647 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-25599067-a73a-40d3-ace4-f5bae9b5f444 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:52:01.286271 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-25599067-a73a-40d3-ace4-f5bae9b5f444 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9" status: 200 len: 1452 microversion: 2.1 time: 0.155582 Jun 07 08:52:01.286836 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 528/1061] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:52:01 2022] GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:52:03.435240 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-3051dcc1-82c3-4ae5-843c-9a0e91712309 req-b87d0d30-9d28-4efd-8364-a2c268b51a5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cf010ae-3b1c-4424-93a1-909556809cd9", "tag": "36a00b70-8f30-434a-8856-2a4e360e4631"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:52:03.443783 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-3051dcc1-82c3-4ae5-843c-9a0e91712309 req-b87d0d30-9d28-4efd-8364-a2c268b51a5a service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:52:03.444230 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-3051dcc1-82c3-4ae5-843c-9a0e91712309 req-b87d0d30-9d28-4efd-8364-a2c268b51a5a service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:52:03.455921 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-3051dcc1-82c3-4ae5-843c-9a0e91712309 req-b87d0d30-9d28-4efd-8364-a2c268b51a5a service nova] Creating event network-changed:36a00b70-8f30-434a-8856-2a4e360e4631 for instance 1cf010ae-3b1c-4424-93a1-909556809cd9 on hv-cinder-74014 Jun 07 08:52:03.461369 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-3051dcc1-82c3-4ae5-843c-9a0e91712309 req-b87d0d30-9d28-4efd-8364-a2c268b51a5a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086328 Jun 07 08:52:03.463255 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 534/1062] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:53:25.627013 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 08:53:25.627650 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Tue Jun 7 08:53:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 08:53:59.899695 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR oslo.messaging._drivers.impl_rabbit [-] [22101f46-f8ff-4959-bd90-6328c9c0b9d0] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 07 08:53:59.900522 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:53:59.901317 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=58 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:53:59.905873 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-c44d3365-5b71-433c-b4d7-2cdf62e3273b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:53:59.906371 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-c44d3365-5b71-433c-b4d7-2cdf62e3273b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 1cf010ae-3b1c-4424-93a1-909556809cd9] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:53:59.913179 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c44d3365-5b71-433c-b4d7-2cdf62e3273b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:53:59.915987 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c44d3365-5b71-433c-b4d7-2cdf62e3273b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:53:59.915987 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c44d3365-5b71-433c-b4d7-2cdf62e3273b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:53:59.915987 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c44d3365-5b71-433c-b4d7-2cdf62e3273b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:53:59.940786 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-c44d3365-5b71-433c-b4d7-2cdf62e3273b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 1cf010ae-3b1c-4424-93a1-909556809cd9] Going to try to terminate instance {{(pid=129726) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 08:54:00.322717 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-c44d3365-5b71-433c-b4d7-2cdf62e3273b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9" status: 204 len: 0 microversion: 2.1 time: 0.424504 Jun 07 08:54:00.323303 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 529/1063] 10.222.0.17 () {58 vars in 1238 bytes} [Tue Jun 7 08:53:59 2022] DELETE /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 08:54:00.329798 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8404486c-b2f7-43b3-ab21-18dd2e25ef65] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 07 08:54:00.330425 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_api:SELECT=24 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:54:00.331164 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=52 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:54:00.335565 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-ea36b180-d7d0-4024-be76-10288170fce7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:54:00.336265 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-ea36b180-d7d0-4024-be76-10288170fce7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 1cf010ae-3b1c-4424-93a1-909556809cd9] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:54:00.342833 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ea36b180-d7d0-4024-be76-10288170fce7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:00.345450 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ea36b180-d7d0-4024-be76-10288170fce7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:00.345450 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ea36b180-d7d0-4024-be76-10288170fce7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:00.345450 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ea36b180-d7d0-4024-be76-10288170fce7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:00.527167 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-ea36b180-d7d0-4024-be76-10288170fce7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:54:00.535143 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-ea36b180-d7d0-4024-be76-10288170fce7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9" status: 200 len: 1577 microversion: 2.1 time: 0.207278 Jun 07 08:54:00.535695 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 535/1064] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:54:00 2022] GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9 => generated 1577 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:54:01.553954 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-2c70ea25-9f58-43ae-bbb7-8f537568c4ca tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:54:01.554568 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-2c70ea25-9f58-43ae-bbb7-8f537568c4ca tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 1cf010ae-3b1c-4424-93a1-909556809cd9] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:54:01.565719 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO oslo.messaging._drivers.impl_rabbit [-] [22101f46-f8ff-4959-bd90-6328c9c0b9d0] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 54196. Jun 07 08:54:01.569826 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2c70ea25-9f58-43ae-bbb7-8f537568c4ca tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:01.570273 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2c70ea25-9f58-43ae-bbb7-8f537568c4ca tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:01.571040 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2c70ea25-9f58-43ae-bbb7-8f537568c4ca tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:01.571494 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2c70ea25-9f58-43ae-bbb7-8f537568c4ca tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:01.763288 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-2c70ea25-9f58-43ae-bbb7-8f537568c4ca tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:54:01.770867 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-2c70ea25-9f58-43ae-bbb7-8f537568c4ca tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9" status: 200 len: 1577 microversion: 2.1 time: 0.221238 Jun 07 08:54:01.771434 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 530/1065] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:54:01 2022] GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9 => generated 1577 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:54:02.788378 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-14093c22-ae2f-4599-b4a5-cfd5f180f01b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:54:02.789098 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-14093c22-ae2f-4599-b4a5-cfd5f180f01b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 1cf010ae-3b1c-4424-93a1-909556809cd9] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:54:02.797946 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-14093c22-ae2f-4599-b4a5-cfd5f180f01b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:02.798740 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-14093c22-ae2f-4599-b4a5-cfd5f180f01b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:02.799165 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-14093c22-ae2f-4599-b4a5-cfd5f180f01b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:02.800308 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-14093c22-ae2f-4599-b4a5-cfd5f180f01b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:02.805291 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO oslo.messaging._drivers.impl_rabbit [-] [8404486c-b2f7-43b3-ab21-18dd2e25ef65] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 54204. Jun 07 08:54:02.909694 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-14093c22-ae2f-4599-b4a5-cfd5f180f01b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:54:02.909694 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-14093c22-ae2f-4599-b4a5-cfd5f180f01b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9" status: 200 len: 1510 microversion: 2.1 time: 0.114231 Jun 07 08:54:02.909694 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 536/1066] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:54:02 2022] GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9 => generated 1510 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:54:03.497788 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-0eab2f1b-3eb3-464c-b901-62e0317d17a2 req-0e8d2719-9c5c-493c-a341-c56ca1478d40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cf010ae-3b1c-4424-93a1-909556809cd9", "name": "network-vif-deleted", "tag": "36a00b70-8f30-434a-8856-2a4e360e4631"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:54:03.506443 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-0eab2f1b-3eb3-464c-b901-62e0317d17a2 req-0e8d2719-9c5c-493c-a341-c56ca1478d40 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:03.506891 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-0eab2f1b-3eb3-464c-b901-62e0317d17a2 req-0e8d2719-9c5c-493c-a341-c56ca1478d40 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:03.518413 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-0eab2f1b-3eb3-464c-b901-62e0317d17a2 req-0e8d2719-9c5c-493c-a341-c56ca1478d40 service nova] Creating event network-vif-deleted:36a00b70-8f30-434a-8856-2a4e360e4631 for instance 1cf010ae-3b1c-4424-93a1-909556809cd9 on hv-cinder-74014 Jun 07 08:54:03.523969 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-0eab2f1b-3eb3-464c-b901-62e0317d17a2 req-0e8d2719-9c5c-493c-a341-c56ca1478d40 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087824 Jun 07 08:54:03.524582 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 531/1067] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:54:03.915750 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-a6450622-d9c9-4d56-aa6f-3a430c398e1b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:54:03.923483 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-a6450622-d9c9-4d56-aa6f-3a430c398e1b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 1cf010ae-3b1c-4424-93a1-909556809cd9] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:54:03.923483 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a6450622-d9c9-4d56-aa6f-3a430c398e1b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:03.923743 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a6450622-d9c9-4d56-aa6f-3a430c398e1b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:03.925136 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a6450622-d9c9-4d56-aa6f-3a430c398e1b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:03.925917 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-a6450622-d9c9-4d56-aa6f-3a430c398e1b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:03.996262 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-a6450622-d9c9-4d56-aa6f-3a430c398e1b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:54:04.004226 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-a6450622-d9c9-4d56-aa6f-3a430c398e1b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9" status: 200 len: 1225 microversion: 2.1 time: 0.092458 Jun 07 08:54:04.005061 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 537/1068] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:54:03 2022] GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:54:05.022400 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-4e5cf753-b7f5-488e-a009-98b4954f5be3 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:54:05.023535 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-4e5cf753-b7f5-488e-a009-98b4954f5be3 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 1cf010ae-3b1c-4424-93a1-909556809cd9] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:54:05.030815 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4e5cf753-b7f5-488e-a009-98b4954f5be3 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:05.031259 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4e5cf753-b7f5-488e-a009-98b4954f5be3 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:05.032024 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4e5cf753-b7f5-488e-a009-98b4954f5be3 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:05.032456 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-4e5cf753-b7f5-488e-a009-98b4954f5be3 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:05.046692 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.wsgi [None req-4e5cf753-b7f5-488e-a009-98b4954f5be3 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] HTTP exception thrown: Instance 1cf010ae-3b1c-4424-93a1-909556809cd9 could not be found. Jun 07 08:54:05.048331 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-4e5cf753-b7f5-488e-a009-98b4954f5be3 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Request method failure captured: Jun 07 08:54:05.048331 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: request: GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9 HTTP/1.1 Jun 07 08:54:05.048331 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept: application/json Jun 07 08:54:05.048331 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept-Encoding: identity Jun 07 08:54:05.048331 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Connection: close Jun 07 08:54:05.048331 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Length: 0 Jun 07 08:54:05.048331 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Type: application/json Jun 07 08:54:05.048331 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Host: 10.222.0.17 Jun 07 08:54:05.048331 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Openstack-System-Scope: None Jun 07 08:54:05.048331 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: User-Agent: python-urllib3/1.26.9 Jun 07 08:54:05.048331 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Auth-Token: gAAAAABinxGACDg_A-u2buQuuqdnW5XRhb9jWDQkVxCHdzRkVJE4wSKe2oMYx6FFjif1NlQ0BBsbntCyyFI_nZKb4lXGtqM-nBlvUJ8FLW8EURDletKagjEnJnFd7NQu6bFiwxMqJqD1FlImc954IRusF50PHPKb-56DNrREw7ihMpVEykEBR2g Jun 07 08:54:05.048331 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Id: None Jun 07 08:54:05.048331 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Name: None Jun 07 08:54:05.048331 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Identity-Status: Confirmed Jun 07 08:54:05.048331 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Is-Admin-Project: True Jun 07 08:54:05.048331 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Id: default Jun 07 08:54:05.048331 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Name: Default Jun 07 08:54:05.048331 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Id: af50419d91204a8eb8c1dca13803aa2f Jun 07 08:54:05.048331 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Name: tempest-TestVolumeBootPattern-227742588 Jun 07 08:54:05.048331 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Role: reader,member Jun 07 08:54:05.048331 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Roles: reader,member Jun 07 08:54:05.050120 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/af50419d91204a8eb8c1dca13803aa2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/af50419d91204a8eb8c1dca13803aa2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_af50419d91204a8eb8c1dca13803aa2f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/af50419d91204a8eb8c1dca13803aa2f"}]}] Jun 07 08:54:05.050120 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant: tempest-TestVolumeBootPattern-227742588 Jun 07 08:54:05.050120 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Id: af50419d91204a8eb8c1dca13803aa2f Jun 07 08:54:05.050120 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Name: tempest-TestVolumeBootPattern-227742588 Jun 07 08:54:05.050120 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User: tempest-TestVolumeBootPattern-227742588-project Jun 07 08:54:05.050120 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Id: default Jun 07 08:54:05.050120 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Name: Default Jun 07 08:54:05.050120 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Id: 55abc5e9e3a24da9abae9a2c44466b8f Jun 07 08:54:05.050120 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Name: tempest-TestVolumeBootPattern-227742588-project Jun 07 08:54:05.050120 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: method: > Jun 07 08:54:05.050120 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: exception: Instance 1cf010ae-3b1c-4424-93a1-909556809cd9 could not be found. Jun 07 08:54:05.050120 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: action_args: {'id': '1cf010ae-3b1c-4424-93a1-909556809cd9'} Jun 07 08:54:05.051221 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:54:05.051221 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:54:05.051221 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:54:05.051221 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:54:05.051221 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:54:05.051221 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:54:05.051221 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:54:05.051221 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:54:05.051221 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:54:05.051221 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:54:05.051221 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cf010ae-3b1c-4424-93a1-909556809cd9 could not be found. Jun 07 08:54:05.051221 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:54:05.051221 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:54:05.051221 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:54:05.051221 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:54:05.051221 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:54:05.051221 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:54:05.051221 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:54:05.051221 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:54:05.051221 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:54:05.052556 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:54:05.052556 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 08:54:05.052556 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 08:54:05.052556 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:54:05.052556 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:54:05.052556 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:54:05.052556 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:54:05.052556 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cf010ae-3b1c-4424-93a1-909556809cd9 could not be found. Jun 07 08:54:05.052556 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:54:05.052556 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:54:05.052556 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:54:05.052556 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:54:05.052556 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:54:05.052556 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:54:05.052556 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:54:05.052556 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:54:05.052556 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cf010ae-3b1c-4424-93a1-909556809cd9 could not be found. Jun 07 08:54:05.052556 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:54:05.053871 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-4e5cf753-b7f5-488e-a009-98b4954f5be3 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Returning 404 to user: Instance 1cf010ae-3b1c-4424-93a1-909556809cd9 could not be found. {{(pid=129726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:54:05.053871 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-4e5cf753-b7f5-488e-a009-98b4954f5be3 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9" status: 404 len: 111 microversion: 2.1 time: 0.031886 Jun 07 08:54:05.053871 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 532/1069] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:54:05 2022] GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:54:05.096652 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-8accf3ef-49eb-4cb5-ac89-69a2546b874e tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1134567099", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-996397736", "security_groups": [{"name": "tempest-secgroup-smoke-325903687"}], "block_device_mapping_v2": [{"uuid": "85e3ccd1-209a-4d4f-a9a1-a8ff0b2aece4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "807de0cf-4a8a-45df-b7af-2f900ed52dc0"}]}} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:54:05.215612 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.network.neutron [None req-8accf3ef-49eb-4cb5-ac89-69a2546b874e tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] validate_networks() for [('807de0cf-4a8a-45df-b7af-2f900ed52dc0', None, None, None, None, None)] {{(pid=129725) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 08:54:05.626759 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-8accf3ef-49eb-4cb5-ac89-69a2546b874e tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Flavor limits 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 08:54:05.627183 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-8accf3ef-49eb-4cb5-ac89-69a2546b874e tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Image limits 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 08:54:05.627656 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-8accf3ef-49eb-4cb5-ac89-69a2546b874e tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Flavor pref 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 08:54:05.628061 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-8accf3ef-49eb-4cb5-ac89-69a2546b874e tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Image pref 0:0:0 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 08:54:05.628470 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.virt.hardware [None req-8accf3ef-49eb-4cb5-ac89-69a2546b874e tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 08:54:05.637596 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8accf3ef-49eb-4cb5-ac89-69a2546b874e tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:05.638846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8accf3ef-49eb-4cb5-ac89-69a2546b874e tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:05.640035 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8accf3ef-49eb-4cb5-ac89-69a2546b874e tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:05.640480 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-8accf3ef-49eb-4cb5-ac89-69a2546b874e tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:05.658239 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.quota [None req-8accf3ef-49eb-4cb5-ac89-69a2546b874e tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Getting quotas for project af50419d91204a8eb8c1dca13803aa2f. Resources: {'ram', 'cores', 'instances'} {{(pid=129725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 08:54:05.662259 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.quota [None req-8accf3ef-49eb-4cb5-ac89-69a2546b874e tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Getting quotas for user 55abc5e9e3a24da9abae9a2c44466b8f and project af50419d91204a8eb8c1dca13803aa2f. Resources: {'ram', 'cores', 'instances'} {{(pid=129725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 08:54:05.724024 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-8accf3ef-49eb-4cb5-ac89-69a2546b874e tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Going to run 1 instances... {{(pid=129725) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 08:54:05.724024 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-8accf3ef-49eb-4cb5-ac89-69a2546b874e tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 2c68d76e-fc4d-456d-81cb-9adf79177323] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='85e3ccd1-209a-4d4f-a9a1-a8ff0b2aece4',volume_size=None,volume_type=None)] {{(pid=129725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 08:54:06.125842 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-8accf3ef-49eb-4cb5-ac89-69a2546b874e tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.032749 Jun 07 08:54:06.126823 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 538/1070] 10.222.0.17 () {60 vars in 1146 bytes} [Tue Jun 7 08:54:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 08:54:06.136356 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-333f850c-49f3-41a3-a3a2-ac7bb3d3dc2c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:54:06.137116 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-333f850c-49f3-41a3-a3a2-ac7bb3d3dc2c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 2c68d76e-fc4d-456d-81cb-9adf79177323] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:54:06.192948 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-333f850c-49f3-41a3-a3a2-ac7bb3d3dc2c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:54:06.202124 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-333f850c-49f3-41a3-a3a2-ac7bb3d3dc2c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323" status: 200 len: 1094 microversion: 2.1 time: 0.069500 Jun 07 08:54:06.205831 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 533/1071] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:54:06 2022] GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:54:07.219031 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-e2e900e8-a2e7-4d1d-8339-2612519d97c3 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:54:07.219788 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-e2e900e8-a2e7-4d1d-8339-2612519d97c3 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 2c68d76e-fc4d-456d-81cb-9adf79177323] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:54:07.227257 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e2e900e8-a2e7-4d1d-8339-2612519d97c3 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:07.227712 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e2e900e8-a2e7-4d1d-8339-2612519d97c3 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:07.228490 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e2e900e8-a2e7-4d1d-8339-2612519d97c3 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:07.228928 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e2e900e8-a2e7-4d1d-8339-2612519d97c3 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:07.291292 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-e2e900e8-a2e7-4d1d-8339-2612519d97c3 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:54:07.298959 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-e2e900e8-a2e7-4d1d-8339-2612519d97c3 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323" status: 200 len: 1144 microversion: 2.1 time: 0.083647 Jun 07 08:54:07.299286 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 539/1072] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:54:07 2022] GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323 => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:54:08.314906 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-d10322f4-0dc7-4dc7-a175-8f79b04c46c9 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:54:08.315569 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-d10322f4-0dc7-4dc7-a175-8f79b04c46c9 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 2c68d76e-fc4d-456d-81cb-9adf79177323] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:54:08.322649 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d10322f4-0dc7-4dc7-a175-8f79b04c46c9 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:08.323094 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d10322f4-0dc7-4dc7-a175-8f79b04c46c9 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:08.323867 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d10322f4-0dc7-4dc7-a175-8f79b04c46c9 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:08.324315 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-d10322f4-0dc7-4dc7-a175-8f79b04c46c9 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:08.401774 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-d10322f4-0dc7-4dc7-a175-8f79b04c46c9 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:54:08.411170 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-d10322f4-0dc7-4dc7-a175-8f79b04c46c9 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323" status: 200 len: 1200 microversion: 2.1 time: 0.100098 Jun 07 08:54:08.412157 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 534/1073] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:54:08 2022] GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323 => generated 1200 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:54:09.429596 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-97dacd8a-dc20-4876-b7af-b63bcfc66d8b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:54:09.430209 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-97dacd8a-dc20-4876-b7af-b63bcfc66d8b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 2c68d76e-fc4d-456d-81cb-9adf79177323] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:54:09.437857 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-97dacd8a-dc20-4876-b7af-b63bcfc66d8b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:09.438410 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-97dacd8a-dc20-4876-b7af-b63bcfc66d8b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:09.439275 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-97dacd8a-dc20-4876-b7af-b63bcfc66d8b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:09.439816 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-97dacd8a-dc20-4876-b7af-b63bcfc66d8b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:09.650334 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-97dacd8a-dc20-4876-b7af-b63bcfc66d8b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:54:09.659052 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-97dacd8a-dc20-4876-b7af-b63bcfc66d8b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323" status: 200 len: 1277 microversion: 2.1 time: 0.233677 Jun 07 08:54:09.659640 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 540/1074] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:54:09 2022] GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323 => generated 1277 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:54:10.107265 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-bca682fa-3d9d-4a87-8692-69de41ea6704 req-7b61cf19-167e-4425-aca6-b3212371511f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c68d76e-fc4d-456d-81cb-9adf79177323", "tag": "e3c775ba-5fe3-4d04-a31a-301421d2d2ec"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:54:10.118513 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-bca682fa-3d9d-4a87-8692-69de41ea6704 req-7b61cf19-167e-4425-aca6-b3212371511f service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:10.118513 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-bca682fa-3d9d-4a87-8692-69de41ea6704 req-7b61cf19-167e-4425-aca6-b3212371511f service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:10.129610 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-bca682fa-3d9d-4a87-8692-69de41ea6704 req-7b61cf19-167e-4425-aca6-b3212371511f service nova] Creating event network-changed:e3c775ba-5fe3-4d04-a31a-301421d2d2ec for instance 2c68d76e-fc4d-456d-81cb-9adf79177323 on hv-cinder-74014 Jun 07 08:54:10.134792 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-bca682fa-3d9d-4a87-8692-69de41ea6704 req-7b61cf19-167e-4425-aca6-b3212371511f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031792 Jun 07 08:54:10.135598 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 535/1075] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:54:10.676791 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-ab2a4c67-59bd-461a-9263-e312effac35c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:54:10.677444 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-ab2a4c67-59bd-461a-9263-e312effac35c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 2c68d76e-fc4d-456d-81cb-9adf79177323] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:54:10.684027 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ab2a4c67-59bd-461a-9263-e312effac35c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:10.684772 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ab2a4c67-59bd-461a-9263-e312effac35c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:10.685588 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ab2a4c67-59bd-461a-9263-e312effac35c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:10.686031 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-ab2a4c67-59bd-461a-9263-e312effac35c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:10.902238 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-ab2a4c67-59bd-461a-9263-e312effac35c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:54:10.910279 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-ab2a4c67-59bd-461a-9263-e312effac35c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323" status: 200 len: 1265 microversion: 2.1 time: 0.238472 Jun 07 08:54:10.910846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 541/1076] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:54:10 2022] GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323 => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:54:11.929082 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-34d1babb-2156-4d69-ab26-c28ff5777749 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:54:11.929784 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-34d1babb-2156-4d69-ab26-c28ff5777749 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 2c68d76e-fc4d-456d-81cb-9adf79177323] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:54:11.936190 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-34d1babb-2156-4d69-ab26-c28ff5777749 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:11.936639 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-34d1babb-2156-4d69-ab26-c28ff5777749 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:11.937443 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-34d1babb-2156-4d69-ab26-c28ff5777749 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:11.937885 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-34d1babb-2156-4d69-ab26-c28ff5777749 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:12.069756 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-34d1babb-2156-4d69-ab26-c28ff5777749 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:54:12.078069 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-34d1babb-2156-4d69-ab26-c28ff5777749 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323" status: 200 len: 1265 microversion: 2.1 time: 0.153599 Jun 07 08:54:12.078634 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 536/1077] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:54:11 2022] GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:54:13.095559 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-871d1de2-50b8-4d3e-8949-f6cf6f77ff90 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:54:13.096343 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-871d1de2-50b8-4d3e-8949-f6cf6f77ff90 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 2c68d76e-fc4d-456d-81cb-9adf79177323] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:54:13.102988 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-871d1de2-50b8-4d3e-8949-f6cf6f77ff90 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:13.103437 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-871d1de2-50b8-4d3e-8949-f6cf6f77ff90 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:13.104203 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-871d1de2-50b8-4d3e-8949-f6cf6f77ff90 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:13.104638 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-871d1de2-50b8-4d3e-8949-f6cf6f77ff90 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:13.242898 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-871d1de2-50b8-4d3e-8949-f6cf6f77ff90 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:54:13.250924 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-871d1de2-50b8-4d3e-8949-f6cf6f77ff90 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323" status: 200 len: 1265 microversion: 2.1 time: 0.159790 Jun 07 08:54:13.251489 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 542/1078] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:54:13 2022] GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:54:14.268328 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-93739136-775c-4bd7-9f33-7eddd080f1f1 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:54:14.268936 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-93739136-775c-4bd7-9f33-7eddd080f1f1 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 2c68d76e-fc4d-456d-81cb-9adf79177323] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:54:14.275801 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-93739136-775c-4bd7-9f33-7eddd080f1f1 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:14.276245 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-93739136-775c-4bd7-9f33-7eddd080f1f1 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:14.277028 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-93739136-775c-4bd7-9f33-7eddd080f1f1 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:14.277465 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-93739136-775c-4bd7-9f33-7eddd080f1f1 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:14.411571 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-93739136-775c-4bd7-9f33-7eddd080f1f1 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:54:14.419311 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-93739136-775c-4bd7-9f33-7eddd080f1f1 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323" status: 200 len: 1265 microversion: 2.1 time: 0.154720 Jun 07 08:54:14.419880 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 537/1079] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:54:14 2022] GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:54:15.435904 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-fcc8ad2b-ea85-474f-bb3f-7ea4fea9bce3 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:54:15.436507 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-fcc8ad2b-ea85-474f-bb3f-7ea4fea9bce3 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 2c68d76e-fc4d-456d-81cb-9adf79177323] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:54:15.443116 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-fcc8ad2b-ea85-474f-bb3f-7ea4fea9bce3 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:15.443566 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-fcc8ad2b-ea85-474f-bb3f-7ea4fea9bce3 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:15.444367 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-fcc8ad2b-ea85-474f-bb3f-7ea4fea9bce3 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:15.444802 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-fcc8ad2b-ea85-474f-bb3f-7ea4fea9bce3 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:15.575412 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-fcc8ad2b-ea85-474f-bb3f-7ea4fea9bce3 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:54:15.582828 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-fcc8ad2b-ea85-474f-bb3f-7ea4fea9bce3 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323" status: 200 len: 1265 microversion: 2.1 time: 0.150941 Jun 07 08:54:15.583396 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 543/1080] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:54:15 2022] GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:54:16.600399 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-01400deb-9cf0-4242-8b37-1c6edb4e5d25 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:54:16.601057 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-01400deb-9cf0-4242-8b37-1c6edb4e5d25 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 2c68d76e-fc4d-456d-81cb-9adf79177323] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:54:16.603488 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell0:SELECT=2 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:54:16.608852 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-01400deb-9cf0-4242-8b37-1c6edb4e5d25 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:16.609353 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-01400deb-9cf0-4242-8b37-1c6edb4e5d25 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:16.610127 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-01400deb-9cf0-4242-8b37-1c6edb4e5d25 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:16.610569 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-01400deb-9cf0-4242-8b37-1c6edb4e5d25 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:16.757867 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-01400deb-9cf0-4242-8b37-1c6edb4e5d25 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:54:16.765829 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-01400deb-9cf0-4242-8b37-1c6edb4e5d25 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323" status: 200 len: 1265 microversion: 2.1 time: 0.169325 Jun 07 08:54:16.773571 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 538/1081] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:54:16 2022] GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:54:17.783337 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-899c57e9-ee64-40ec-b8ab-f8fd7b175ede tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:54:17.783954 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-899c57e9-ee64-40ec-b8ab-f8fd7b175ede tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 2c68d76e-fc4d-456d-81cb-9adf79177323] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:54:17.785790 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell0:SELECT=2 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:54:17.786570 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell0:SELECT=6 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:54:17.791771 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-899c57e9-ee64-40ec-b8ab-f8fd7b175ede tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:17.792225 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-899c57e9-ee64-40ec-b8ab-f8fd7b175ede tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:17.793010 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-899c57e9-ee64-40ec-b8ab-f8fd7b175ede tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:17.793453 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-899c57e9-ee64-40ec-b8ab-f8fd7b175ede tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:17.933952 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-899c57e9-ee64-40ec-b8ab-f8fd7b175ede tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:54:17.942112 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-899c57e9-ee64-40ec-b8ab-f8fd7b175ede tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323" status: 200 len: 1265 microversion: 2.1 time: 0.162699 Jun 07 08:54:17.942676 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 544/1082] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:54:17 2022] GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:54:18.959136 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-f0f10a0c-88db-448c-9dab-a165d6b39678 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:54:18.959684 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-f0f10a0c-88db-448c-9dab-a165d6b39678 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 2c68d76e-fc4d-456d-81cb-9adf79177323] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:54:18.967043 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f0f10a0c-88db-448c-9dab-a165d6b39678 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:18.967487 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f0f10a0c-88db-448c-9dab-a165d6b39678 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:18.968248 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f0f10a0c-88db-448c-9dab-a165d6b39678 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:18.968686 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f0f10a0c-88db-448c-9dab-a165d6b39678 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:19.101900 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-f0f10a0c-88db-448c-9dab-a165d6b39678 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:54:19.109419 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-f0f10a0c-88db-448c-9dab-a165d6b39678 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323" status: 200 len: 1265 microversion: 2.1 time: 0.154139 Jun 07 08:54:19.109995 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 539/1083] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:54:18 2022] GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:54:20.126377 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-4db30051-a6bd-4fe3-84d9-1ceb252fe096 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:54:20.127000 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-4db30051-a6bd-4fe3-84d9-1ceb252fe096 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 2c68d76e-fc4d-456d-81cb-9adf79177323] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:54:20.133627 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4db30051-a6bd-4fe3-84d9-1ceb252fe096 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:20.134082 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4db30051-a6bd-4fe3-84d9-1ceb252fe096 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:20.134857 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4db30051-a6bd-4fe3-84d9-1ceb252fe096 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:20.135300 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-4db30051-a6bd-4fe3-84d9-1ceb252fe096 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:20.276059 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-4db30051-a6bd-4fe3-84d9-1ceb252fe096 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:54:20.291945 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-4db30051-a6bd-4fe3-84d9-1ceb252fe096 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323" status: 200 len: 1265 microversion: 2.1 time: 0.168954 Jun 07 08:54:20.293018 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 545/1084] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:54:20 2022] GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:54:20.393966 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-501b6f11-a9e9-4191-aae3-f36419c1bb2f req-3bfef969-6e79-47f7-8460-ff1a11997702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c68d76e-fc4d-456d-81cb-9adf79177323", "name": "network-vif-plugged", "status": "completed", "tag": "e3c775ba-5fe3-4d04-a31a-301421d2d2ec"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:54:20.402985 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-501b6f11-a9e9-4191-aae3-f36419c1bb2f req-3bfef969-6e79-47f7-8460-ff1a11997702 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:20.404006 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-501b6f11-a9e9-4191-aae3-f36419c1bb2f req-3bfef969-6e79-47f7-8460-ff1a11997702 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:20.415855 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-501b6f11-a9e9-4191-aae3-f36419c1bb2f req-3bfef969-6e79-47f7-8460-ff1a11997702 service nova] Creating event network-vif-plugged:e3c775ba-5fe3-4d04-a31a-301421d2d2ec for instance 2c68d76e-fc4d-456d-81cb-9adf79177323 on hv-cinder-74014 Jun 07 08:54:20.421080 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-501b6f11-a9e9-4191-aae3-f36419c1bb2f req-3bfef969-6e79-47f7-8460-ff1a11997702 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030871 Jun 07 08:54:20.421686 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 540/1085] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:54:21.317039 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-e6885e9d-6936-40d4-b9a8-2037f78e6d03 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:54:21.317603 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-e6885e9d-6936-40d4-b9a8-2037f78e6d03 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 2c68d76e-fc4d-456d-81cb-9adf79177323] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:54:21.324241 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e6885e9d-6936-40d4-b9a8-2037f78e6d03 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:21.324687 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e6885e9d-6936-40d4-b9a8-2037f78e6d03 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:21.325489 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e6885e9d-6936-40d4-b9a8-2037f78e6d03 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:21.325923 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e6885e9d-6936-40d4-b9a8-2037f78e6d03 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:21.459338 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-e6885e9d-6936-40d4-b9a8-2037f78e6d03 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:54:21.467574 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-e6885e9d-6936-40d4-b9a8-2037f78e6d03 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323" status: 200 len: 1265 microversion: 2.1 time: 0.154691 Jun 07 08:54:21.468140 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 546/1086] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:54:21 2022] GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:54:22.491259 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-66bac287-1604-4377-ae51-ed26604db87b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:54:22.491259 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-66bac287-1604-4377-ae51-ed26604db87b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 2c68d76e-fc4d-456d-81cb-9adf79177323] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:54:22.492614 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-66bac287-1604-4377-ae51-ed26604db87b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:22.493099 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-66bac287-1604-4377-ae51-ed26604db87b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:22.493898 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-66bac287-1604-4377-ae51-ed26604db87b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:22.494342 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-66bac287-1604-4377-ae51-ed26604db87b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:22.635626 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-66bac287-1604-4377-ae51-ed26604db87b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:54:22.644350 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-66bac287-1604-4377-ae51-ed26604db87b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323" status: 200 len: 1265 microversion: 2.1 time: 0.163936 Jun 07 08:54:22.644968 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 541/1087] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:54:22 2022] GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:54:23.663090 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-f6cf59e4-375a-4d94-9a42-18641f595565 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:54:23.663704 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-f6cf59e4-375a-4d94-9a42-18641f595565 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 2c68d76e-fc4d-456d-81cb-9adf79177323] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:54:23.670799 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f6cf59e4-375a-4d94-9a42-18641f595565 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:23.671243 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f6cf59e4-375a-4d94-9a42-18641f595565 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:23.672004 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f6cf59e4-375a-4d94-9a42-18641f595565 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:23.672437 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f6cf59e4-375a-4d94-9a42-18641f595565 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:23.838201 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-f6cf59e4-375a-4d94-9a42-18641f595565 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:54:23.846366 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-f6cf59e4-375a-4d94-9a42-18641f595565 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323" status: 200 len: 1453 microversion: 2.1 time: 0.187226 Jun 07 08:54:23.846946 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 547/1088] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:54:23 2022] GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323 => generated 1453 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:54:23.863441 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-5c06d49e-71c6-4162-8164-49b2976f1fff tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:54:23.864044 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-5c06d49e-71c6-4162-8164-49b2976f1fff tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 2c68d76e-fc4d-456d-81cb-9adf79177323] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:54:23.870192 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5c06d49e-71c6-4162-8164-49b2976f1fff tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:23.870634 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5c06d49e-71c6-4162-8164-49b2976f1fff tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:23.871394 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5c06d49e-71c6-4162-8164-49b2976f1fff tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:23.871888 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-5c06d49e-71c6-4162-8164-49b2976f1fff tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:24.005741 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-5c06d49e-71c6-4162-8164-49b2976f1fff tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:54:24.013789 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-5c06d49e-71c6-4162-8164-49b2976f1fff tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323" status: 200 len: 1453 microversion: 2.1 time: 0.154592 Jun 07 08:54:24.014360 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 542/1089] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:54:23 2022] GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:54:26.296378 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-79966dba-841f-47b6-aaba-63a417c000d2 req-42f2398c-4455-4f03-9a5b-da09ccf3cba1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c68d76e-fc4d-456d-81cb-9adf79177323", "tag": "e3c775ba-5fe3-4d04-a31a-301421d2d2ec"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:54:26.304797 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-79966dba-841f-47b6-aaba-63a417c000d2 req-42f2398c-4455-4f03-9a5b-da09ccf3cba1 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:54:26.305305 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-79966dba-841f-47b6-aaba-63a417c000d2 req-42f2398c-4455-4f03-9a5b-da09ccf3cba1 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:54:26.316800 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-79966dba-841f-47b6-aaba-63a417c000d2 req-42f2398c-4455-4f03-9a5b-da09ccf3cba1 service nova] Creating event network-changed:e3c775ba-5fe3-4d04-a31a-301421d2d2ec for instance 2c68d76e-fc4d-456d-81cb-9adf79177323 on hv-cinder-74014 Jun 07 08:54:26.322034 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-79966dba-841f-47b6-aaba-63a417c000d2 req-42f2398c-4455-4f03-9a5b-da09ccf3cba1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029939 Jun 07 08:54:26.322626 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 548/1090] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:56:01.118187 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:56:01.118952 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:56:01.122984 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-8fef1a6c-677b-46d3-aa9a-3dab3c71f1ca tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1994903861", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-996397736", "security_groups": [{"name": "tempest-secgroup-smoke-325903687"}], "block_device_mapping_v2": [{"uuid": "9c746280-b4ae-44ae-a4ad-2c736ca99ee0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "807de0cf-4a8a-45df-b7af-2f900ed52dc0"}]}} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:56:01.248868 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.network.neutron [None req-8fef1a6c-677b-46d3-aa9a-3dab3c71f1ca tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] validate_networks() for [('807de0cf-4a8a-45df-b7af-2f900ed52dc0', None, None, None, None, None)] {{(pid=129726) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 07 08:56:01.620690 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-8fef1a6c-677b-46d3-aa9a-3dab3c71f1ca tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Flavor limits 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 07 08:56:01.621158 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-8fef1a6c-677b-46d3-aa9a-3dab3c71f1ca tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Image limits 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 07 08:56:01.621638 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-8fef1a6c-677b-46d3-aa9a-3dab3c71f1ca tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Flavor pref 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 07 08:56:01.622048 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-8fef1a6c-677b-46d3-aa9a-3dab3c71f1ca tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Image pref 0:0:0 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 07 08:56:01.622466 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.virt.hardware [None req-8fef1a6c-677b-46d3-aa9a-3dab3c71f1ca tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129726) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 07 08:56:01.632257 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8fef1a6c-677b-46d3-aa9a-3dab3c71f1ca tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:01.632699 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8fef1a6c-677b-46d3-aa9a-3dab3c71f1ca tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:01.633538 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8fef1a6c-677b-46d3-aa9a-3dab3c71f1ca tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:01.633975 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-8fef1a6c-677b-46d3-aa9a-3dab3c71f1ca tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:01.652408 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-8fef1a6c-677b-46d3-aa9a-3dab3c71f1ca tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Getting quotas for project af50419d91204a8eb8c1dca13803aa2f. Resources: {'ram', 'cores', 'instances'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 07 08:56:01.656659 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.quota [None req-8fef1a6c-677b-46d3-aa9a-3dab3c71f1ca tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Getting quotas for user 55abc5e9e3a24da9abae9a2c44466b8f and project af50419d91204a8eb8c1dca13803aa2f. Resources: {'ram', 'cores', 'instances'} {{(pid=129726) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 07 08:56:01.714086 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-8fef1a6c-677b-46d3-aa9a-3dab3c71f1ca tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Going to run 1 instances... {{(pid=129726) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 07 08:56:01.716179 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-8fef1a6c-677b-46d3-aa9a-3dab3c71f1ca tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: b702d203-1f94-48a2-ba34-772693ca6fb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9c746280-b4ae-44ae-a4ad-2c736ca99ee0',volume_size=None,volume_type=None)] {{(pid=129726) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 07 08:56:02.154525 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8fef1a6c-677b-46d3-aa9a-3dab3c71f1ca tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [d5485d84-a5ac-46e8-987d-ca382407e9d6] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 07 08:56:03.162270 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO oslo.messaging._drivers.impl_rabbit [None req-8fef1a6c-677b-46d3-aa9a-3dab3c71f1ca tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [d5485d84-a5ac-46e8-987d-ca382407e9d6] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 54364. Jun 07 08:56:03.166502 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-8fef1a6c-677b-46d3-aa9a-3dab3c71f1ca tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.050290 Jun 07 08:56:03.167179 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 543/1091] 10.222.0.17 () {60 vars in 1146 bytes} [Tue Jun 7 08:56:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 2052 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 07 08:56:03.176815 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8404486c-b2f7-43b3-ab21-18dd2e25ef65] AMQP server on 10.222.0.17:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 07 08:56:03.177536 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:56:03.178239 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=76 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:56:03.184305 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-85579256-6146-4c41-beb2-6488503032c2 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:56:03.185227 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-85579256-6146-4c41-beb2-6488503032c2 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: b702d203-1f94-48a2-ba34-772693ca6fb2] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:56:03.240591 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-85579256-6146-4c41-beb2-6488503032c2 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:56:03.247637 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-85579256-6146-4c41-beb2-6488503032c2 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2" status: 200 len: 1094 microversion: 2.1 time: 0.074106 Jun 07 08:56:03.248225 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 549/1092] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:56:03 2022] GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:56:04.265430 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-279ad69b-e186-4d5f-9793-8469748c4c51 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:56:04.266060 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-279ad69b-e186-4d5f-9793-8469748c4c51 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: b702d203-1f94-48a2-ba34-772693ca6fb2] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:56:04.273600 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-279ad69b-e186-4d5f-9793-8469748c4c51 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:04.274049 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-279ad69b-e186-4d5f-9793-8469748c4c51 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:04.274813 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-279ad69b-e186-4d5f-9793-8469748c4c51 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:04.275251 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-279ad69b-e186-4d5f-9793-8469748c4c51 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:04.336343 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-279ad69b-e186-4d5f-9793-8469748c4c51 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:56:04.344151 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-279ad69b-e186-4d5f-9793-8469748c4c51 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2" status: 200 len: 1144 microversion: 2.1 time: 0.083153 Jun 07 08:56:04.344717 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 544/1093] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:56:04 2022] GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:56:05.365934 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-cdbc605a-71b3-4e5c-aead-0a2ab99d6cf7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:56:05.366569 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-cdbc605a-71b3-4e5c-aead-0a2ab99d6cf7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: b702d203-1f94-48a2-ba34-772693ca6fb2] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:56:05.376307 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-cdbc605a-71b3-4e5c-aead-0a2ab99d6cf7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:05.376665 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-cdbc605a-71b3-4e5c-aead-0a2ab99d6cf7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:05.378065 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-cdbc605a-71b3-4e5c-aead-0a2ab99d6cf7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:05.378511 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-cdbc605a-71b3-4e5c-aead-0a2ab99d6cf7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:05.384347 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO oslo.messaging._drivers.impl_rabbit [-] [8404486c-b2f7-43b3-ab21-18dd2e25ef65] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 54384. Jun 07 08:56:05.488490 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-cdbc605a-71b3-4e5c-aead-0a2ab99d6cf7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:56:05.496359 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-cdbc605a-71b3-4e5c-aead-0a2ab99d6cf7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2" status: 200 len: 1200 microversion: 2.1 time: 0.137763 Jun 07 08:56:05.499262 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 550/1094] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:56:05 2022] GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2 => generated 1200 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:56:06.513751 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-b987d27c-febf-4bca-bc17-d527397aecf7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:56:06.514479 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-b987d27c-febf-4bca-bc17-d527397aecf7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: b702d203-1f94-48a2-ba34-772693ca6fb2] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:56:06.521457 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b987d27c-febf-4bca-bc17-d527397aecf7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:06.521912 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b987d27c-febf-4bca-bc17-d527397aecf7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:06.522686 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b987d27c-febf-4bca-bc17-d527397aecf7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:06.523125 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b987d27c-febf-4bca-bc17-d527397aecf7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:06.659968 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-b987d27c-febf-4bca-bc17-d527397aecf7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:56:06.667827 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-b987d27c-febf-4bca-bc17-d527397aecf7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2" status: 200 len: 1277 microversion: 2.1 time: 0.157824 Jun 07 08:56:06.678704 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 545/1095] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:56:06 2022] GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2 => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 07 08:56:07.206638 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-5a845f0b-b69c-4f20-96f7-0f1b2ffd3608 req-05f9d80d-80bd-4215-bae0-224912df9140 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b702d203-1f94-48a2-ba34-772693ca6fb2", "tag": "05d9b570-1015-455d-bff7-7c6054122264"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:56:07.215559 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-5a845f0b-b69c-4f20-96f7-0f1b2ffd3608 req-05f9d80d-80bd-4215-bae0-224912df9140 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:07.216007 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-5a845f0b-b69c-4f20-96f7-0f1b2ffd3608 req-05f9d80d-80bd-4215-bae0-224912df9140 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:07.235751 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-5a845f0b-b69c-4f20-96f7-0f1b2ffd3608 req-05f9d80d-80bd-4215-bae0-224912df9140 service nova] Creating event network-changed:05d9b570-1015-455d-bff7-7c6054122264 for instance b702d203-1f94-48a2-ba34-772693ca6fb2 on hv-cinder-74014 Jun 07 08:56:07.242238 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-5a845f0b-b69c-4f20-96f7-0f1b2ffd3608 req-05f9d80d-80bd-4215-bae0-224912df9140 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042706 Jun 07 08:56:07.243104 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 551/1096] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:56:07.687155 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-f1719059-b858-4f4b-ae82-5175a8040615 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:56:07.687887 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-f1719059-b858-4f4b-ae82-5175a8040615 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: b702d203-1f94-48a2-ba34-772693ca6fb2] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:56:07.695484 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f1719059-b858-4f4b-ae82-5175a8040615 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:07.695933 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f1719059-b858-4f4b-ae82-5175a8040615 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:07.696709 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f1719059-b858-4f4b-ae82-5175a8040615 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:07.697177 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-f1719059-b858-4f4b-ae82-5175a8040615 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:07.837517 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-f1719059-b858-4f4b-ae82-5175a8040615 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:56:07.845147 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-f1719059-b858-4f4b-ae82-5175a8040615 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2" status: 200 len: 1265 microversion: 2.1 time: 0.161783 Jun 07 08:56:07.845729 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 546/1097] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:56:07 2022] GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:56:08.863761 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-29e98653-cf5b-4fd8-a696-231540bf7154 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:56:08.864352 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-29e98653-cf5b-4fd8-a696-231540bf7154 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: b702d203-1f94-48a2-ba34-772693ca6fb2] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:56:08.870888 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-29e98653-cf5b-4fd8-a696-231540bf7154 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:08.871340 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-29e98653-cf5b-4fd8-a696-231540bf7154 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:08.872117 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-29e98653-cf5b-4fd8-a696-231540bf7154 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:08.872551 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-29e98653-cf5b-4fd8-a696-231540bf7154 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:09.008756 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-29e98653-cf5b-4fd8-a696-231540bf7154 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:56:09.016457 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-29e98653-cf5b-4fd8-a696-231540bf7154 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2" status: 200 len: 1265 microversion: 2.1 time: 0.157440 Jun 07 08:56:09.017043 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 552/1098] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:56:08 2022] GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:56:10.034674 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-b8b96791-2917-438a-88ed-02b853a9a562 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:56:10.035287 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-b8b96791-2917-438a-88ed-02b853a9a562 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: b702d203-1f94-48a2-ba34-772693ca6fb2] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:56:10.041947 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b8b96791-2917-438a-88ed-02b853a9a562 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:10.042399 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b8b96791-2917-438a-88ed-02b853a9a562 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:10.043174 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b8b96791-2917-438a-88ed-02b853a9a562 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:10.043615 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-b8b96791-2917-438a-88ed-02b853a9a562 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:10.177938 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-b8b96791-2917-438a-88ed-02b853a9a562 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:56:10.185758 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-b8b96791-2917-438a-88ed-02b853a9a562 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2" status: 200 len: 1265 microversion: 2.1 time: 0.155442 Jun 07 08:56:10.186373 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 547/1099] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:56:10 2022] GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:56:11.202844 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-e6309282-3371-4082-8b34-c8261daed238 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:56:11.203468 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-e6309282-3371-4082-8b34-c8261daed238 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: b702d203-1f94-48a2-ba34-772693ca6fb2] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:56:11.210513 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e6309282-3371-4082-8b34-c8261daed238 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:11.210962 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e6309282-3371-4082-8b34-c8261daed238 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:11.211720 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e6309282-3371-4082-8b34-c8261daed238 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:11.212157 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-e6309282-3371-4082-8b34-c8261daed238 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:11.360147 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-e6309282-3371-4082-8b34-c8261daed238 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:56:11.368052 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-e6309282-3371-4082-8b34-c8261daed238 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2" status: 200 len: 1265 microversion: 2.1 time: 0.168995 Jun 07 08:56:11.368633 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 553/1100] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:56:11 2022] GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:56:12.385584 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-c487412d-cab5-4ce9-afe3-edf93e52cf4e tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:56:12.386207 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-c487412d-cab5-4ce9-afe3-edf93e52cf4e tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: b702d203-1f94-48a2-ba34-772693ca6fb2] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:56:12.388538 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell0:SELECT=2 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:56:12.389241 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell0:SELECT=6 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:56:12.394165 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c487412d-cab5-4ce9-afe3-edf93e52cf4e tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:12.394611 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c487412d-cab5-4ce9-afe3-edf93e52cf4e tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:12.395645 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c487412d-cab5-4ce9-afe3-edf93e52cf4e tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:12.396076 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-c487412d-cab5-4ce9-afe3-edf93e52cf4e tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:12.536701 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-c487412d-cab5-4ce9-afe3-edf93e52cf4e tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:56:12.544485 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-c487412d-cab5-4ce9-afe3-edf93e52cf4e tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2" status: 200 len: 1265 microversion: 2.1 time: 0.162719 Jun 07 08:56:12.545101 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 548/1101] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:56:12 2022] GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:56:13.559251 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell0:SELECT=2 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:56:13.563152 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-2842ab86-521a-4ecf-92fb-1d6471af1b7d tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:56:13.575904 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-2842ab86-521a-4ecf-92fb-1d6471af1b7d tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: b702d203-1f94-48a2-ba34-772693ca6fb2] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:56:13.575904 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2842ab86-521a-4ecf-92fb-1d6471af1b7d tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:13.575904 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2842ab86-521a-4ecf-92fb-1d6471af1b7d tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:13.575904 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2842ab86-521a-4ecf-92fb-1d6471af1b7d tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:13.576291 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-2842ab86-521a-4ecf-92fb-1d6471af1b7d tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:13.711336 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-2842ab86-521a-4ecf-92fb-1d6471af1b7d tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:56:13.719093 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-2842ab86-521a-4ecf-92fb-1d6471af1b7d tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2" status: 200 len: 1265 microversion: 2.1 time: 0.161265 Jun 07 08:56:13.719832 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 554/1102] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:56:13 2022] GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:56:14.736326 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-aa62d855-24ed-4e4b-a837-a6b1aa38dc2c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:56:14.737468 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-aa62d855-24ed-4e4b-a837-a6b1aa38dc2c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: b702d203-1f94-48a2-ba34-772693ca6fb2] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:56:14.744188 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-aa62d855-24ed-4e4b-a837-a6b1aa38dc2c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:14.744608 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-aa62d855-24ed-4e4b-a837-a6b1aa38dc2c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:14.745408 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-aa62d855-24ed-4e4b-a837-a6b1aa38dc2c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:14.745845 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-aa62d855-24ed-4e4b-a837-a6b1aa38dc2c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:14.878752 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-aa62d855-24ed-4e4b-a837-a6b1aa38dc2c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:56:14.886281 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-aa62d855-24ed-4e4b-a837-a6b1aa38dc2c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2" status: 200 len: 1265 microversion: 2.1 time: 0.153850 Jun 07 08:56:14.886863 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 549/1103] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:56:14 2022] GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:56:15.903191 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-dfa0dd3f-7e92-42f6-bfcc-9f0cacfe7146 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:56:15.903816 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-dfa0dd3f-7e92-42f6-bfcc-9f0cacfe7146 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: b702d203-1f94-48a2-ba34-772693ca6fb2] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:56:15.910686 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-dfa0dd3f-7e92-42f6-bfcc-9f0cacfe7146 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:15.911139 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-dfa0dd3f-7e92-42f6-bfcc-9f0cacfe7146 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:15.911915 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-dfa0dd3f-7e92-42f6-bfcc-9f0cacfe7146 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:15.912352 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-dfa0dd3f-7e92-42f6-bfcc-9f0cacfe7146 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:16.042877 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-dfa0dd3f-7e92-42f6-bfcc-9f0cacfe7146 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:56:16.050433 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-dfa0dd3f-7e92-42f6-bfcc-9f0cacfe7146 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2" status: 200 len: 1265 microversion: 2.1 time: 0.151131 Jun 07 08:56:16.051000 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 555/1104] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:56:15 2022] GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:56:17.000575 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-e91cf35a-c346-44d3-b6c5-a2563c04a219 req-637d524b-3cd9-4474-809c-75b3e2ae0ffb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b702d203-1f94-48a2-ba34-772693ca6fb2", "name": "network-vif-plugged", "status": "completed", "tag": "05d9b570-1015-455d-bff7-7c6054122264"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:56:17.009512 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-e91cf35a-c346-44d3-b6c5-a2563c04a219 req-637d524b-3cd9-4474-809c-75b3e2ae0ffb service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:17.010004 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-e91cf35a-c346-44d3-b6c5-a2563c04a219 req-637d524b-3cd9-4474-809c-75b3e2ae0ffb service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:17.022120 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-e91cf35a-c346-44d3-b6c5-a2563c04a219 req-637d524b-3cd9-4474-809c-75b3e2ae0ffb service nova] Creating event network-vif-plugged:05d9b570-1015-455d-bff7-7c6054122264 for instance b702d203-1f94-48a2-ba34-772693ca6fb2 on hv-cinder-74014 Jun 07 08:56:17.027231 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-e91cf35a-c346-44d3-b6c5-a2563c04a219 req-637d524b-3cd9-4474-809c-75b3e2ae0ffb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031373 Jun 07 08:56:17.027820 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 550/1105] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:56:17.067638 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-f75d2ce6-086f-4b5e-9755-0d42c236700b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:56:17.068802 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-f75d2ce6-086f-4b5e-9755-0d42c236700b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: b702d203-1f94-48a2-ba34-772693ca6fb2] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:56:17.076896 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f75d2ce6-086f-4b5e-9755-0d42c236700b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:17.077459 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f75d2ce6-086f-4b5e-9755-0d42c236700b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:17.078529 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f75d2ce6-086f-4b5e-9755-0d42c236700b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:17.078963 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-f75d2ce6-086f-4b5e-9755-0d42c236700b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:17.225789 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-f75d2ce6-086f-4b5e-9755-0d42c236700b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:56:17.233828 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-f75d2ce6-086f-4b5e-9755-0d42c236700b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2" status: 200 len: 1265 microversion: 2.1 time: 0.170157 Jun 07 08:56:17.234425 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 556/1106] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:56:17 2022] GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:56:18.250955 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-ff7154d1-4bfe-45cd-8ce7-4e72a26f0e0c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:56:18.251658 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-ff7154d1-4bfe-45cd-8ce7-4e72a26f0e0c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: b702d203-1f94-48a2-ba34-772693ca6fb2] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:56:18.258839 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ff7154d1-4bfe-45cd-8ce7-4e72a26f0e0c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:18.259292 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ff7154d1-4bfe-45cd-8ce7-4e72a26f0e0c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:18.260059 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ff7154d1-4bfe-45cd-8ce7-4e72a26f0e0c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:18.260499 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ff7154d1-4bfe-45cd-8ce7-4e72a26f0e0c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:18.392475 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-ff7154d1-4bfe-45cd-8ce7-4e72a26f0e0c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:56:18.401247 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-ff7154d1-4bfe-45cd-8ce7-4e72a26f0e0c tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2" status: 200 len: 1265 microversion: 2.1 time: 0.154891 Jun 07 08:56:18.401829 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 551/1107] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:56:18 2022] GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:56:19.473927 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-c77ac7e1-55a4-4820-9617-c89cd53d4bc6 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:56:19.474538 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-c77ac7e1-55a4-4820-9617-c89cd53d4bc6 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: b702d203-1f94-48a2-ba34-772693ca6fb2] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:56:19.480610 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c77ac7e1-55a4-4820-9617-c89cd53d4bc6 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:19.481082 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c77ac7e1-55a4-4820-9617-c89cd53d4bc6 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:19.481857 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c77ac7e1-55a4-4820-9617-c89cd53d4bc6 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:19.482288 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-c77ac7e1-55a4-4820-9617-c89cd53d4bc6 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:19.621397 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-c77ac7e1-55a4-4820-9617-c89cd53d4bc6 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:56:19.628915 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-c77ac7e1-55a4-4820-9617-c89cd53d4bc6 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2" status: 200 len: 1452 microversion: 2.1 time: 0.215012 Jun 07 08:56:19.629566 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 557/1108] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:56:19 2022] GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2 => generated 1452 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:56:19.651547 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-519da3d4-4f6c-428c-9f48-f824d60f90a4 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:56:19.652190 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-519da3d4-4f6c-428c-9f48-f824d60f90a4 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: b702d203-1f94-48a2-ba34-772693ca6fb2] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:56:19.658945 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-519da3d4-4f6c-428c-9f48-f824d60f90a4 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:19.659396 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-519da3d4-4f6c-428c-9f48-f824d60f90a4 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:19.660176 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-519da3d4-4f6c-428c-9f48-f824d60f90a4 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:19.660680 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-519da3d4-4f6c-428c-9f48-f824d60f90a4 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:19.802875 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-519da3d4-4f6c-428c-9f48-f824d60f90a4 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:56:19.810819 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-519da3d4-4f6c-428c-9f48-f824d60f90a4 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2" status: 200 len: 1452 microversion: 2.1 time: 0.163229 Jun 07 08:56:19.811395 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 552/1109] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:56:19 2022] GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2 => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:56:21.966668 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-b2fef185-6a1b-4c46-adad-b68c7207e2cc req-3e2099e9-3ca4-41d2-b00f-658e11f30bed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b702d203-1f94-48a2-ba34-772693ca6fb2", "tag": "05d9b570-1015-455d-bff7-7c6054122264"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:56:21.975952 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-b2fef185-6a1b-4c46-adad-b68c7207e2cc req-3e2099e9-3ca4-41d2-b00f-658e11f30bed service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:56:21.976481 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-b2fef185-6a1b-4c46-adad-b68c7207e2cc req-3e2099e9-3ca4-41d2-b00f-658e11f30bed service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:56:21.988451 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-b2fef185-6a1b-4c46-adad-b68c7207e2cc req-3e2099e9-3ca4-41d2-b00f-658e11f30bed service nova] Creating event network-changed:05d9b570-1015-455d-bff7-7c6054122264 for instance b702d203-1f94-48a2-ba34-772693ca6fb2 on hv-cinder-74014 Jun 07 08:56:21.994144 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-b2fef185-6a1b-4c46-adad-b68c7207e2cc req-3e2099e9-3ca4-41d2-b00f-658e11f30bed service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031143 Jun 07 08:56:21.994993 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 558/1110] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:56:34.395038 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 08:56:34.395917 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Tue Jun 7 08:56:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 08:56:35.534624 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 08:56:35.535304 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Tue Jun 7 08:56:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 08:56:45.635830 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 08:56:45.636469 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Tue Jun 7 08:56:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 08:58:06.349298 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:58:06.349298 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG dbcounter [-] [129726] Writing DB stats nova_cell1:SELECT=52 {{(pid=129726) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:58:06.353853 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-2f16c448-6532-44e4-81e2-bfc0f6802a15 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:58:06.354357 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-2f16c448-6532-44e4-81e2-bfc0f6802a15 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: b702d203-1f94-48a2-ba34-772693ca6fb2] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:58:06.358318 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_api:SELECT=22 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:58:06.359314 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG dbcounter [-] [129725] Writing DB stats nova_cell1:SELECT=46 {{(pid=129725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 07 08:58:06.360955 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2f16c448-6532-44e4-81e2-bfc0f6802a15 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:58:06.362115 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2f16c448-6532-44e4-81e2-bfc0f6802a15 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:58:06.362281 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2f16c448-6532-44e4-81e2-bfc0f6802a15 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:58:06.362679 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2f16c448-6532-44e4-81e2-bfc0f6802a15 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:58:06.392450 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-2f16c448-6532-44e4-81e2-bfc0f6802a15 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: b702d203-1f94-48a2-ba34-772693ca6fb2] Going to try to terminate instance {{(pid=129726) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 08:58:06.426177 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-83f24399-d0f2-484d-83c4-c9355b56daa4 req-155476d9-2705-466a-8ab3-af7884733781 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b702d203-1f94-48a2-ba34-772693ca6fb2", "tag": "05d9b570-1015-455d-bff7-7c6054122264"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:58:06.436387 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-83f24399-d0f2-484d-83c4-c9355b56daa4 req-155476d9-2705-466a-8ab3-af7884733781 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:58:06.436869 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-83f24399-d0f2-484d-83c4-c9355b56daa4 req-155476d9-2705-466a-8ab3-af7884733781 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:58:06.448454 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-83f24399-d0f2-484d-83c4-c9355b56daa4 req-155476d9-2705-466a-8ab3-af7884733781 service nova] Creating event network-changed:05d9b570-1015-455d-bff7-7c6054122264 for instance b702d203-1f94-48a2-ba34-772693ca6fb2 on hv-cinder-74014 Jun 07 08:58:06.453841 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-83f24399-d0f2-484d-83c4-c9355b56daa4 req-155476d9-2705-466a-8ab3-af7884733781 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102716 Jun 07 08:58:06.454775 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 559/1111] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:58:06.683981 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-2f16c448-6532-44e4-81e2-bfc0f6802a15 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2" status: 204 len: 0 microversion: 2.1 time: 0.337254 Jun 07 08:58:06.685348 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 553/1112] 10.222.0.17 () {58 vars in 1238 bytes} [Tue Jun 7 08:58:06 2022] DELETE /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 08:58:06.694234 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-25f3913c-6f16-4ed6-bf79-829deec11dcd tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:58:06.695580 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-25f3913c-6f16-4ed6-bf79-829deec11dcd tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: b702d203-1f94-48a2-ba34-772693ca6fb2] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:58:06.704280 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-25f3913c-6f16-4ed6-bf79-829deec11dcd tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:58:06.704280 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-25f3913c-6f16-4ed6-bf79-829deec11dcd tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:58:06.704634 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-25f3913c-6f16-4ed6-bf79-829deec11dcd tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:58:06.705750 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-25f3913c-6f16-4ed6-bf79-829deec11dcd tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:58:06.850445 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-25f3913c-6f16-4ed6-bf79-829deec11dcd tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:58:06.858644 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-25f3913c-6f16-4ed6-bf79-829deec11dcd tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2" status: 200 len: 1577 microversion: 2.1 time: 0.168972 Jun 07 08:58:06.859239 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 560/1113] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:58:06 2022] GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:58:07.876922 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-fbede915-35d5-4d01-8bc5-7a905291b712 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:58:07.877953 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-fbede915-35d5-4d01-8bc5-7a905291b712 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: b702d203-1f94-48a2-ba34-772693ca6fb2] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:58:07.884800 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fbede915-35d5-4d01-8bc5-7a905291b712 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:58:07.885288 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fbede915-35d5-4d01-8bc5-7a905291b712 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:58:07.886053 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fbede915-35d5-4d01-8bc5-7a905291b712 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:58:07.886489 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-fbede915-35d5-4d01-8bc5-7a905291b712 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:58:08.032214 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-fbede915-35d5-4d01-8bc5-7a905291b712 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:58:08.040814 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-fbede915-35d5-4d01-8bc5-7a905291b712 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2" status: 200 len: 1577 microversion: 2.1 time: 0.168144 Jun 07 08:58:08.041424 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 554/1114] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:58:07 2022] GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:58:09.058526 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-48ea1015-0822-4bfa-a13e-4aade83b5bc7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:58:09.062125 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-48ea1015-0822-4bfa-a13e-4aade83b5bc7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: b702d203-1f94-48a2-ba34-772693ca6fb2] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:58:09.065971 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-48ea1015-0822-4bfa-a13e-4aade83b5bc7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:58:09.066448 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-48ea1015-0822-4bfa-a13e-4aade83b5bc7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:58:09.067222 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-48ea1015-0822-4bfa-a13e-4aade83b5bc7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:58:09.067655 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-48ea1015-0822-4bfa-a13e-4aade83b5bc7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:58:09.088448 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [req-43ca268f-9d47-4eac-bdcf-c3301779f8da req-5e3466bd-69d3-4d39-bdd8-c3a1e9f2b785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b702d203-1f94-48a2-ba34-772693ca6fb2", "name": "network-vif-deleted", "tag": "05d9b570-1015-455d-bff7-7c6054122264"}]} {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:58:09.097212 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-43ca268f-9d47-4eac-bdcf-c3301779f8da req-5e3466bd-69d3-4d39-bdd8-c3a1e9f2b785 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:58:09.097635 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [req-43ca268f-9d47-4eac-bdcf-c3301779f8da req-5e3466bd-69d3-4d39-bdd8-c3a1e9f2b785 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:58:09.109958 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.compute.server_external_events [req-43ca268f-9d47-4eac-bdcf-c3301779f8da req-5e3466bd-69d3-4d39-bdd8-c3a1e9f2b785 service nova] Creating event network-vif-deleted:05d9b570-1015-455d-bff7-7c6054122264 for instance b702d203-1f94-48a2-ba34-772693ca6fb2 on hv-cinder-74014 Jun 07 08:58:09.115057 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [req-43ca268f-9d47-4eac-bdcf-c3301779f8da req-5e3466bd-69d3-4d39-bdd8-c3a1e9f2b785 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030141 Jun 07 08:58:09.115909 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 555/1115] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 07 08:58:09.141043 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-48ea1015-0822-4bfa-a13e-4aade83b5bc7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:58:09.149153 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-48ea1015-0822-4bfa-a13e-4aade83b5bc7 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2" status: 200 len: 1391 microversion: 2.1 time: 0.095364 Jun 07 08:58:09.149723 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 561/1116] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:58:09 2022] GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2 => generated 1391 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:58:10.167537 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-2d58837b-e9c4-479c-b6f5-8672b87c2d5b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:58:10.168231 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-2d58837b-e9c4-479c-b6f5-8672b87c2d5b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: b702d203-1f94-48a2-ba34-772693ca6fb2] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:58:10.175360 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2d58837b-e9c4-479c-b6f5-8672b87c2d5b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:58:10.175805 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2d58837b-e9c4-479c-b6f5-8672b87c2d5b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:58:10.176576 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2d58837b-e9c4-479c-b6f5-8672b87c2d5b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:58:10.177030 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2d58837b-e9c4-479c-b6f5-8672b87c2d5b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:58:10.209636 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2d58837b-e9c4-479c-b6f5-8672b87c2d5b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:58:10.210666 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-2d58837b-e9c4-479c-b6f5-8672b87c2d5b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:58:10.211088 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.objects.instance [None req-2d58837b-e9c4-479c-b6f5-8672b87c2d5b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lazy-loading 'fault' on Instance uuid b702d203-1f94-48a2-ba34-772693ca6fb2 {{(pid=129726) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:58:10.253407 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-2d58837b-e9c4-479c-b6f5-8672b87c2d5b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:58:10.261111 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-2d58837b-e9c4-479c-b6f5-8672b87c2d5b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2" status: 200 len: 1230 microversion: 2.1 time: 0.098396 Jun 07 08:58:10.261947 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 556/1117] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:58:10 2022] GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2 => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:58:11.280917 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-46424ab1-2d96-407e-b063-b07ad7d65f31 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:58:11.281652 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-46424ab1-2d96-407e-b063-b07ad7d65f31 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: b702d203-1f94-48a2-ba34-772693ca6fb2] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:58:11.288812 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-46424ab1-2d96-407e-b063-b07ad7d65f31 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:58:11.289293 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-46424ab1-2d96-407e-b063-b07ad7d65f31 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:58:11.290093 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-46424ab1-2d96-407e-b063-b07ad7d65f31 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:58:11.290590 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-46424ab1-2d96-407e-b063-b07ad7d65f31 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:58:11.305756 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.wsgi [None req-46424ab1-2d96-407e-b063-b07ad7d65f31 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] HTTP exception thrown: Instance b702d203-1f94-48a2-ba34-772693ca6fb2 could not be found. Jun 07 08:58:11.307430 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-46424ab1-2d96-407e-b063-b07ad7d65f31 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Request method failure captured: Jun 07 08:58:11.307430 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: request: GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2 HTTP/1.1 Jun 07 08:58:11.307430 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept: application/json Jun 07 08:58:11.307430 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept-Encoding: identity Jun 07 08:58:11.307430 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Connection: close Jun 07 08:58:11.307430 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Length: 0 Jun 07 08:58:11.307430 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Type: application/json Jun 07 08:58:11.307430 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Host: 10.222.0.17 Jun 07 08:58:11.307430 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Openstack-System-Scope: None Jun 07 08:58:11.307430 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: User-Agent: python-urllib3/1.26.9 Jun 07 08:58:11.307430 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Auth-Token: gAAAAABinxGACDg_A-u2buQuuqdnW5XRhb9jWDQkVxCHdzRkVJE4wSKe2oMYx6FFjif1NlQ0BBsbntCyyFI_nZKb4lXGtqM-nBlvUJ8FLW8EURDletKagjEnJnFd7NQu6bFiwxMqJqD1FlImc954IRusF50PHPKb-56DNrREw7ihMpVEykEBR2g Jun 07 08:58:11.307430 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Id: None Jun 07 08:58:11.307430 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Name: None Jun 07 08:58:11.307430 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Identity-Status: Confirmed Jun 07 08:58:11.307430 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Is-Admin-Project: True Jun 07 08:58:11.307430 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Id: default Jun 07 08:58:11.307430 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Name: Default Jun 07 08:58:11.307430 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Id: af50419d91204a8eb8c1dca13803aa2f Jun 07 08:58:11.307430 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Name: tempest-TestVolumeBootPattern-227742588 Jun 07 08:58:11.307430 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Role: reader,member Jun 07 08:58:11.307430 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Roles: reader,member Jun 07 08:58:11.309326 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/af50419d91204a8eb8c1dca13803aa2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/af50419d91204a8eb8c1dca13803aa2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_af50419d91204a8eb8c1dca13803aa2f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/af50419d91204a8eb8c1dca13803aa2f"}]}] Jun 07 08:58:11.309326 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant: tempest-TestVolumeBootPattern-227742588 Jun 07 08:58:11.309326 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Id: af50419d91204a8eb8c1dca13803aa2f Jun 07 08:58:11.309326 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Name: tempest-TestVolumeBootPattern-227742588 Jun 07 08:58:11.309326 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User: tempest-TestVolumeBootPattern-227742588-project Jun 07 08:58:11.309326 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Id: default Jun 07 08:58:11.309326 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Name: Default Jun 07 08:58:11.309326 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Id: 55abc5e9e3a24da9abae9a2c44466b8f Jun 07 08:58:11.309326 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Name: tempest-TestVolumeBootPattern-227742588-project Jun 07 08:58:11.309326 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: method: > Jun 07 08:58:11.309326 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: exception: Instance b702d203-1f94-48a2-ba34-772693ca6fb2 could not be found. Jun 07 08:58:11.309326 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: action_args: {'id': 'b702d203-1f94-48a2-ba34-772693ca6fb2'} Jun 07 08:58:11.310556 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:58:11.310556 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:58:11.310556 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:58:11.310556 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:58:11.310556 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:58:11.310556 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:58:11.310556 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:58:11.310556 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:58:11.310556 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:58:11.310556 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:58:11.310556 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b702d203-1f94-48a2-ba34-772693ca6fb2 could not be found. Jun 07 08:58:11.310556 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:58:11.310556 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:58:11.310556 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:58:11.310556 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:58:11.310556 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:58:11.310556 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:58:11.310556 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:58:11.310556 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:58:11.310556 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:58:11.312205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:58:11.312205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 08:58:11.312205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 08:58:11.312205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:58:11.312205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:58:11.312205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:58:11.312205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:58:11.312205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b702d203-1f94-48a2-ba34-772693ca6fb2 could not be found. Jun 07 08:58:11.312205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:58:11.312205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:58:11.312205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:58:11.312205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:58:11.312205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:58:11.312205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:58:11.312205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:58:11.312205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:58:11.312205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b702d203-1f94-48a2-ba34-772693ca6fb2 could not be found. Jun 07 08:58:11.312205 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:58:11.313826 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-46424ab1-2d96-407e-b063-b07ad7d65f31 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Returning 404 to user: Instance b702d203-1f94-48a2-ba34-772693ca6fb2 could not be found. {{(pid=129725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:58:11.313826 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-46424ab1-2d96-407e-b063-b07ad7d65f31 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2" status: 404 len: 111 microversion: 2.1 time: 0.031874 Jun 07 08:58:11.313826 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 562/1118] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:58:11 2022] GET /compute/v2.1/servers/b702d203-1f94-48a2-ba34-772693ca6fb2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:58:14.687049 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-31577ebe-d0da-4a3b-9f38-a5982f330c9b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:58:14.691730 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-31577ebe-d0da-4a3b-9f38-a5982f330c9b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 2c68d76e-fc4d-456d-81cb-9adf79177323] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:58:14.691874 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-86e8b68a-f85a-4b65-9451-68b186269c71 req-81309f06-4154-4279-8508-fc3aec5da527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c68d76e-fc4d-456d-81cb-9adf79177323", "tag": "e3c775ba-5fe3-4d04-a31a-301421d2d2ec"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:58:14.699036 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-31577ebe-d0da-4a3b-9f38-a5982f330c9b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:58:14.699877 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-31577ebe-d0da-4a3b-9f38-a5982f330c9b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:58:14.701529 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-31577ebe-d0da-4a3b-9f38-a5982f330c9b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:58:14.702229 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-31577ebe-d0da-4a3b-9f38-a5982f330c9b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:58:14.703451 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-86e8b68a-f85a-4b65-9451-68b186269c71 req-81309f06-4154-4279-8508-fc3aec5da527 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:58:14.703806 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-86e8b68a-f85a-4b65-9451-68b186269c71 req-81309f06-4154-4279-8508-fc3aec5da527 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:58:14.718687 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-86e8b68a-f85a-4b65-9451-68b186269c71 req-81309f06-4154-4279-8508-fc3aec5da527 service nova] Creating event network-changed:e3c775ba-5fe3-4d04-a31a-301421d2d2ec for instance 2c68d76e-fc4d-456d-81cb-9adf79177323 on hv-cinder-74014 Jun 07 08:58:14.723857 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-86e8b68a-f85a-4b65-9451-68b186269c71 req-81309f06-4154-4279-8508-fc3aec5da527 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042241 Jun 07 08:58:14.724459 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 563/1119] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:58:14.733183 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-31577ebe-d0da-4a3b-9f38-a5982f330c9b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 2c68d76e-fc4d-456d-81cb-9adf79177323] Going to try to terminate instance {{(pid=129726) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 07 08:58:15.082452 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-31577ebe-d0da-4a3b-9f38-a5982f330c9b tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323" status: 204 len: 0 microversion: 2.1 time: 0.402464 Jun 07 08:58:15.086520 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 557/1120] 10.222.0.17 () {58 vars in 1238 bytes} [Tue Jun 7 08:58:14 2022] DELETE /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 07 08:58:15.092101 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-497d9ae2-e94a-42e6-9648-4adf99c78362 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:58:15.093168 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-497d9ae2-e94a-42e6-9648-4adf99c78362 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 2c68d76e-fc4d-456d-81cb-9adf79177323] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:58:15.099934 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-497d9ae2-e94a-42e6-9648-4adf99c78362 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:58:15.101218 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-497d9ae2-e94a-42e6-9648-4adf99c78362 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:58:15.102007 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-497d9ae2-e94a-42e6-9648-4adf99c78362 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:58:15.102448 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-497d9ae2-e94a-42e6-9648-4adf99c78362 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:58:15.268048 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-497d9ae2-e94a-42e6-9648-4adf99c78362 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:58:15.276252 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-497d9ae2-e94a-42e6-9648-4adf99c78362 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323" status: 200 len: 1578 microversion: 2.1 time: 0.188366 Jun 07 08:58:15.276833 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 564/1121] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:58:15 2022] GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323 => generated 1578 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:58:16.294040 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-a83b3770-5ac0-40ef-aee0-9834c4dd2ef1 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:58:16.294749 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-a83b3770-5ac0-40ef-aee0-9834c4dd2ef1 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 2c68d76e-fc4d-456d-81cb-9adf79177323] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:58:16.301744 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a83b3770-5ac0-40ef-aee0-9834c4dd2ef1 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:58:16.302199 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a83b3770-5ac0-40ef-aee0-9834c4dd2ef1 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:58:16.302977 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a83b3770-5ac0-40ef-aee0-9834c4dd2ef1 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:58:16.303416 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-a83b3770-5ac0-40ef-aee0-9834c4dd2ef1 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:58:16.445673 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-a83b3770-5ac0-40ef-aee0-9834c4dd2ef1 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:58:16.453415 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-a83b3770-5ac0-40ef-aee0-9834c4dd2ef1 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323" status: 200 len: 1578 microversion: 2.1 time: 0.163575 Jun 07 08:58:16.457819 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 558/1122] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:58:16 2022] GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323 => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:58:17.394604 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [req-ba3212ef-29c6-4aec-9b59-b0dfe07e7f89 req-62a3a594-4227-481d-9db7-a5b779305bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c68d76e-fc4d-456d-81cb-9adf79177323", "name": "network-vif-deleted", "tag": "e3c775ba-5fe3-4d04-a31a-301421d2d2ec"}]} {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 07 08:58:17.403295 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-ba3212ef-29c6-4aec-9b59-b0dfe07e7f89 req-62a3a594-4227-481d-9db7-a5b779305bf5 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:58:17.403737 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [req-ba3212ef-29c6-4aec-9b59-b0dfe07e7f89 req-62a3a594-4227-481d-9db7-a5b779305bf5 service nova] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:58:17.414993 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.compute.server_external_events [req-ba3212ef-29c6-4aec-9b59-b0dfe07e7f89 req-62a3a594-4227-481d-9db7-a5b779305bf5 service nova] Creating event network-vif-deleted:e3c775ba-5fe3-4d04-a31a-301421d2d2ec for instance 2c68d76e-fc4d-456d-81cb-9adf79177323 on hv-cinder-74014 Jun 07 08:58:17.419988 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [req-ba3212ef-29c6-4aec-9b59-b0dfe07e7f89 req-62a3a594-4227-481d-9db7-a5b779305bf5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029356 Jun 07 08:58:17.420504 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 565/1123] 10.222.0.17 () {64 vars in 1317 bytes} [Tue Jun 7 08:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 07 08:58:17.471123 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-472b0e83-88fd-44fb-97b7-488aa161f64f tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:58:17.471747 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-472b0e83-88fd-44fb-97b7-488aa161f64f tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 2c68d76e-fc4d-456d-81cb-9adf79177323] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:58:17.478757 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-472b0e83-88fd-44fb-97b7-488aa161f64f tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:58:17.480345 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-472b0e83-88fd-44fb-97b7-488aa161f64f tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:58:17.480345 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-472b0e83-88fd-44fb-97b7-488aa161f64f tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:58:17.480345 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-472b0e83-88fd-44fb-97b7-488aa161f64f tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:58:17.541924 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.policy [None req-472b0e83-88fd-44fb-97b7-488aa161f64f tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129726) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:58:17.549624 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-472b0e83-88fd-44fb-97b7-488aa161f64f tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323" status: 200 len: 1392 microversion: 2.1 time: 0.082351 Jun 07 08:58:17.550209 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 559/1124] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:58:17 2022] GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323 => generated 1392 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:58:18.568179 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-16664833-c2c0-48c4-b513-cccf983518b0 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:58:18.568882 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-16664833-c2c0-48c4-b513-cccf983518b0 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 2c68d76e-fc4d-456d-81cb-9adf79177323] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:58:18.575762 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-16664833-c2c0-48c4-b513-cccf983518b0 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:58:18.576213 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-16664833-c2c0-48c4-b513-cccf983518b0 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:58:18.577097 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-16664833-c2c0-48c4-b513-cccf983518b0 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:58:18.577515 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-16664833-c2c0-48c4-b513-cccf983518b0 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:58:18.608683 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-16664833-c2c0-48c4-b513-cccf983518b0 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:58:18.609173 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-16664833-c2c0-48c4-b513-cccf983518b0 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:58:18.609627 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.objects.instance [None req-16664833-c2c0-48c4-b513-cccf983518b0 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lazy-loading 'fault' on Instance uuid 2c68d76e-fc4d-456d-81cb-9adf79177323 {{(pid=129725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 07 08:58:18.652955 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.policy [None req-16664833-c2c0-48c4-b513-cccf983518b0 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55abc5e9e3a24da9abae9a2c44466b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af50419d91204a8eb8c1dca13803aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 07 08:58:18.660855 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-16664833-c2c0-48c4-b513-cccf983518b0 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323" status: 200 len: 1230 microversion: 2.1 time: 0.097456 Jun 07 08:58:18.661584 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 566/1125] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:58:18 2022] GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323 => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 07 08:58:19.681427 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-3dffc6cb-d354-447a-a1ac-244a6d4cd97a tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:58:19.682039 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-3dffc6cb-d354-447a-a1ac-244a6d4cd97a tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 2c68d76e-fc4d-456d-81cb-9adf79177323] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:58:19.688789 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3dffc6cb-d354-447a-a1ac-244a6d4cd97a tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:58:19.690003 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3dffc6cb-d354-447a-a1ac-244a6d4cd97a tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:58:19.690191 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3dffc6cb-d354-447a-a1ac-244a6d4cd97a tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:58:19.690636 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-3dffc6cb-d354-447a-a1ac-244a6d4cd97a tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:58:19.707004 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.wsgi [None req-3dffc6cb-d354-447a-a1ac-244a6d4cd97a tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] HTTP exception thrown: Instance 2c68d76e-fc4d-456d-81cb-9adf79177323 could not be found. Jun 07 08:58:19.708621 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-3dffc6cb-d354-447a-a1ac-244a6d4cd97a tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Request method failure captured: Jun 07 08:58:19.708621 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: request: GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323 HTTP/1.1 Jun 07 08:58:19.708621 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept: application/json Jun 07 08:58:19.708621 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept-Encoding: identity Jun 07 08:58:19.708621 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Connection: close Jun 07 08:58:19.708621 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Length: 0 Jun 07 08:58:19.708621 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Type: application/json Jun 07 08:58:19.708621 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Host: 10.222.0.17 Jun 07 08:58:19.708621 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Openstack-System-Scope: None Jun 07 08:58:19.708621 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: User-Agent: python-urllib3/1.26.9 Jun 07 08:58:19.708621 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Auth-Token: gAAAAABinxGACDg_A-u2buQuuqdnW5XRhb9jWDQkVxCHdzRkVJE4wSKe2oMYx6FFjif1NlQ0BBsbntCyyFI_nZKb4lXGtqM-nBlvUJ8FLW8EURDletKagjEnJnFd7NQu6bFiwxMqJqD1FlImc954IRusF50PHPKb-56DNrREw7ihMpVEykEBR2g Jun 07 08:58:19.708621 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Id: None Jun 07 08:58:19.708621 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Name: None Jun 07 08:58:19.708621 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Identity-Status: Confirmed Jun 07 08:58:19.708621 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Is-Admin-Project: True Jun 07 08:58:19.708621 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Id: default Jun 07 08:58:19.708621 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Name: Default Jun 07 08:58:19.708621 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Id: af50419d91204a8eb8c1dca13803aa2f Jun 07 08:58:19.708621 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Name: tempest-TestVolumeBootPattern-227742588 Jun 07 08:58:19.708621 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Role: reader,member Jun 07 08:58:19.708621 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Roles: reader,member Jun 07 08:58:19.711988 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/af50419d91204a8eb8c1dca13803aa2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/af50419d91204a8eb8c1dca13803aa2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_af50419d91204a8eb8c1dca13803aa2f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/af50419d91204a8eb8c1dca13803aa2f"}]}] Jun 07 08:58:19.711988 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant: tempest-TestVolumeBootPattern-227742588 Jun 07 08:58:19.711988 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Id: af50419d91204a8eb8c1dca13803aa2f Jun 07 08:58:19.711988 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Name: tempest-TestVolumeBootPattern-227742588 Jun 07 08:58:19.711988 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User: tempest-TestVolumeBootPattern-227742588-project Jun 07 08:58:19.711988 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Id: default Jun 07 08:58:19.711988 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Name: Default Jun 07 08:58:19.711988 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Id: 55abc5e9e3a24da9abae9a2c44466b8f Jun 07 08:58:19.711988 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Name: tempest-TestVolumeBootPattern-227742588-project Jun 07 08:58:19.711988 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: method: > Jun 07 08:58:19.711988 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: exception: Instance 2c68d76e-fc4d-456d-81cb-9adf79177323 could not be found. Jun 07 08:58:19.711988 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: action_args: {'id': '2c68d76e-fc4d-456d-81cb-9adf79177323'} Jun 07 08:58:19.713429 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:58:19.713429 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:58:19.713429 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:58:19.713429 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:58:19.713429 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:58:19.713429 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:58:19.713429 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:58:19.713429 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:58:19.713429 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:58:19.713429 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:58:19.713429 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c68d76e-fc4d-456d-81cb-9adf79177323 could not be found. Jun 07 08:58:19.713429 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:58:19.713429 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:58:19.713429 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:58:19.713429 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:58:19.713429 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:58:19.713429 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:58:19.713429 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:58:19.713429 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:58:19.713429 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:58:19.715823 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:58:19.715823 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 08:58:19.715823 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 08:58:19.715823 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:58:19.715823 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:58:19.715823 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:58:19.715823 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:58:19.715823 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c68d76e-fc4d-456d-81cb-9adf79177323 could not be found. Jun 07 08:58:19.715823 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:58:19.715823 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:58:19.715823 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:58:19.715823 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:58:19.715823 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:58:19.715823 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:58:19.715823 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:58:19.715823 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:58:19.715823 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c68d76e-fc4d-456d-81cb-9adf79177323 could not be found. Jun 07 08:58:19.715823 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:58:19.718339 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-3dffc6cb-d354-447a-a1ac-244a6d4cd97a tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Returning 404 to user: Instance 2c68d76e-fc4d-456d-81cb-9adf79177323 could not be found. {{(pid=129726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:58:19.718339 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-3dffc6cb-d354-447a-a1ac-244a6d4cd97a tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323" status: 404 len: 111 microversion: 2.1 time: 0.032617 Jun 07 08:58:19.718339 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 560/1126] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:58:19 2022] GET /compute/v2.1/servers/2c68d76e-fc4d-456d-81cb-9adf79177323 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:58:20.199243 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-3eea6be6-1167-4906-91b5-7b787da1dd2a tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:58:20.205116 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.compute.api [None req-3eea6be6-1167-4906-91b5-7b787da1dd2a tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 1cf010ae-3b1c-4424-93a1-909556809cd9] Fetching instance by UUID {{(pid=129725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:58:20.206303 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3eea6be6-1167-4906-91b5-7b787da1dd2a tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:58:20.206758 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3eea6be6-1167-4906-91b5-7b787da1dd2a tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:58:20.207522 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3eea6be6-1167-4906-91b5-7b787da1dd2a tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:58:20.207958 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG oslo_concurrency.lockutils [None req-3eea6be6-1167-4906-91b5-7b787da1dd2a tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:58:20.222119 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.wsgi [None req-3eea6be6-1167-4906-91b5-7b787da1dd2a tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] HTTP exception thrown: Instance 1cf010ae-3b1c-4424-93a1-909556809cd9 could not be found. Jun 07 08:58:20.223846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-3eea6be6-1167-4906-91b5-7b787da1dd2a tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Request method failure captured: Jun 07 08:58:20.223846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: request: DELETE /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9 HTTP/1.1 Jun 07 08:58:20.223846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept: application/json Jun 07 08:58:20.223846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Accept-Encoding: identity Jun 07 08:58:20.223846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Connection: close Jun 07 08:58:20.223846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Length: 0 Jun 07 08:58:20.223846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Content-Type: application/json Jun 07 08:58:20.223846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Host: 10.222.0.17 Jun 07 08:58:20.223846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Openstack-System-Scope: None Jun 07 08:58:20.223846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: User-Agent: python-urllib3/1.26.9 Jun 07 08:58:20.223846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Auth-Token: gAAAAABinxGACDg_A-u2buQuuqdnW5XRhb9jWDQkVxCHdzRkVJE4wSKe2oMYx6FFjif1NlQ0BBsbntCyyFI_nZKb4lXGtqM-nBlvUJ8FLW8EURDletKagjEnJnFd7NQu6bFiwxMqJqD1FlImc954IRusF50PHPKb-56DNrREw7ihMpVEykEBR2g Jun 07 08:58:20.223846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Id: None Jun 07 08:58:20.223846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Domain-Name: None Jun 07 08:58:20.223846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Identity-Status: Confirmed Jun 07 08:58:20.223846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Is-Admin-Project: True Jun 07 08:58:20.223846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Id: default Jun 07 08:58:20.223846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Domain-Name: Default Jun 07 08:58:20.223846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Id: af50419d91204a8eb8c1dca13803aa2f Jun 07 08:58:20.223846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Project-Name: tempest-TestVolumeBootPattern-227742588 Jun 07 08:58:20.223846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Role: reader,member Jun 07 08:58:20.223846 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Roles: reader,member Jun 07 08:58:20.226334 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/af50419d91204a8eb8c1dca13803aa2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/af50419d91204a8eb8c1dca13803aa2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_af50419d91204a8eb8c1dca13803aa2f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/af50419d91204a8eb8c1dca13803aa2f"}]}] Jun 07 08:58:20.226334 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant: tempest-TestVolumeBootPattern-227742588 Jun 07 08:58:20.226334 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Id: af50419d91204a8eb8c1dca13803aa2f Jun 07 08:58:20.226334 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-Tenant-Name: tempest-TestVolumeBootPattern-227742588 Jun 07 08:58:20.226334 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User: tempest-TestVolumeBootPattern-227742588-project Jun 07 08:58:20.226334 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Id: default Jun 07 08:58:20.226334 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Domain-Name: Default Jun 07 08:58:20.226334 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Id: 55abc5e9e3a24da9abae9a2c44466b8f Jun 07 08:58:20.226334 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: X-User-Name: tempest-TestVolumeBootPattern-227742588-project Jun 07 08:58:20.226334 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: method: > Jun 07 08:58:20.226334 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: exception: Instance 1cf010ae-3b1c-4424-93a1-909556809cd9 could not be found. Jun 07 08:58:20.226334 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: action_args: {'id': '1cf010ae-3b1c-4424-93a1-909556809cd9'} Jun 07 08:58:20.227336 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:58:20.227336 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:58:20.227336 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:58:20.227336 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:58:20.227336 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:58:20.227336 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:58:20.227336 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:58:20.227336 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:58:20.227336 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:58:20.227336 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:58:20.227336 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cf010ae-3b1c-4424-93a1-909556809cd9 could not be found. Jun 07 08:58:20.227336 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:58:20.227336 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:58:20.227336 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:58:20.227336 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:58:20.227336 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:58:20.227336 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:58:20.227336 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:58:20.227336 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:58:20.227336 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:58:20.229083 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:58:20.229083 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 07 08:58:20.229083 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 07 08:58:20.229083 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 07 08:58:20.229083 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 07 08:58:20.229083 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:58:20.229083 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:58:20.229083 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:58:20.229083 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:58:20.229083 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cf010ae-3b1c-4424-93a1-909556809cd9 could not be found. Jun 07 08:58:20.229083 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:58:20.229083 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:58:20.229083 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:58:20.229083 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:58:20.229083 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:58:20.229083 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:58:20.229083 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:58:20.229083 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:58:20.229083 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cf010ae-3b1c-4424-93a1-909556809cd9 could not be found. Jun 07 08:58:20.229083 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: ERROR nova.api.openstack.wsgi Jun 07 08:58:20.235243 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-3eea6be6-1167-4906-91b5-7b787da1dd2a tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Returning 404 to user: Instance 1cf010ae-3b1c-4424-93a1-909556809cd9 could not be found. {{(pid=129725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:58:20.235243 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-3eea6be6-1167-4906-91b5-7b787da1dd2a tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9" status: 404 len: 111 microversion: 2.1 time: 0.030665 Jun 07 08:58:20.235243 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 567/1127] 10.222.0.17 () {58 vars in 1238 bytes} [Tue Jun 7 08:58:20 2022] DELETE /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:58:20.235565 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-ccc84a16-d191-4bb2-aa47-191a4c974303 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '>' {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:58:20.235565 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.compute.api [None req-ccc84a16-d191-4bb2-aa47-191a4c974303 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] [instance: 1cf010ae-3b1c-4424-93a1-909556809cd9] Fetching instance by UUID {{(pid=129726) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 07 08:58:20.241796 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ccc84a16-d191-4bb2-aa47-191a4c974303 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:58:20.242276 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ccc84a16-d191-4bb2-aa47-191a4c974303 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:58:20.243039 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ccc84a16-d191-4bb2-aa47-191a4c974303 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 07 08:58:20.243479 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG oslo_concurrency.lockutils [None req-ccc84a16-d191-4bb2-aa47-191a4c974303 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Lock "68d8339a-f93e-465c-95c1-304743b93326" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129726) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 07 08:58:20.256973 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.wsgi [None req-ccc84a16-d191-4bb2-aa47-191a4c974303 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] HTTP exception thrown: Instance 1cf010ae-3b1c-4424-93a1-909556809cd9 could not be found. Jun 07 08:58:20.258528 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-ccc84a16-d191-4bb2-aa47-191a4c974303 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Request method failure captured: Jun 07 08:58:20.258528 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: request: GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9 HTTP/1.1 Jun 07 08:58:20.258528 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept: application/json Jun 07 08:58:20.258528 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Accept-Encoding: identity Jun 07 08:58:20.258528 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Connection: close Jun 07 08:58:20.258528 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Length: 0 Jun 07 08:58:20.258528 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Content-Type: application/json Jun 07 08:58:20.258528 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Host: 10.222.0.17 Jun 07 08:58:20.258528 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Openstack-System-Scope: None Jun 07 08:58:20.258528 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: User-Agent: python-urllib3/1.26.9 Jun 07 08:58:20.258528 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Auth-Token: gAAAAABinxGACDg_A-u2buQuuqdnW5XRhb9jWDQkVxCHdzRkVJE4wSKe2oMYx6FFjif1NlQ0BBsbntCyyFI_nZKb4lXGtqM-nBlvUJ8FLW8EURDletKagjEnJnFd7NQu6bFiwxMqJqD1FlImc954IRusF50PHPKb-56DNrREw7ihMpVEykEBR2g Jun 07 08:58:20.258528 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Id: None Jun 07 08:58:20.258528 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Domain-Name: None Jun 07 08:58:20.258528 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Identity-Status: Confirmed Jun 07 08:58:20.258528 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Is-Admin-Project: True Jun 07 08:58:20.258528 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Id: default Jun 07 08:58:20.258528 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Domain-Name: Default Jun 07 08:58:20.258528 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Id: af50419d91204a8eb8c1dca13803aa2f Jun 07 08:58:20.258528 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Project-Name: tempest-TestVolumeBootPattern-227742588 Jun 07 08:58:20.258528 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Role: reader,member Jun 07 08:58:20.258528 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Roles: reader,member Jun 07 08:58:20.260306 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/af50419d91204a8eb8c1dca13803aa2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/af50419d91204a8eb8c1dca13803aa2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_af50419d91204a8eb8c1dca13803aa2f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/af50419d91204a8eb8c1dca13803aa2f"}]}] Jun 07 08:58:20.260306 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant: tempest-TestVolumeBootPattern-227742588 Jun 07 08:58:20.260306 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Id: af50419d91204a8eb8c1dca13803aa2f Jun 07 08:58:20.260306 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-Tenant-Name: tempest-TestVolumeBootPattern-227742588 Jun 07 08:58:20.260306 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User: tempest-TestVolumeBootPattern-227742588-project Jun 07 08:58:20.260306 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Id: default Jun 07 08:58:20.260306 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Domain-Name: Default Jun 07 08:58:20.260306 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Id: 55abc5e9e3a24da9abae9a2c44466b8f Jun 07 08:58:20.260306 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: X-User-Name: tempest-TestVolumeBootPattern-227742588-project Jun 07 08:58:20.260306 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: method: > Jun 07 08:58:20.260306 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: exception: Instance 1cf010ae-3b1c-4424-93a1-909556809cd9 could not be found. Jun 07 08:58:20.260306 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: action_args: {'id': '1cf010ae-3b1c-4424-93a1-909556809cd9'} Jun 07 08:58:20.261511 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: {{(pid=129726) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 07 08:58:20.261511 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:58:20.261511 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 07 08:58:20.261511 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 07 08:58:20.261511 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 07 08:58:20.261511 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 07 08:58:20.261511 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 07 08:58:20.261511 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 07 08:58:20.261511 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 07 08:58:20.261511 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 07 08:58:20.261511 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cf010ae-3b1c-4424-93a1-909556809cd9 could not be found. Jun 07 08:58:20.261511 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:58:20.261511 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:58:20.261511 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:58:20.261511 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:58:20.261511 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:58:20.261511 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:58:20.261511 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 07 08:58:20.261511 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 07 08:58:20.261511 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 07 08:58:20.263358 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 07 08:58:20.263358 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 07 08:58:20.263358 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 07 08:58:20.263358 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 07 08:58:20.263358 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 07 08:58:20.263358 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 07 08:58:20.263358 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 07 08:58:20.263358 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cf010ae-3b1c-4424-93a1-909556809cd9 could not be found. Jun 07 08:58:20.263358 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:58:20.263358 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 07 08:58:20.263358 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:58:20.263358 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 07 08:58:20.263358 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 07 08:58:20.263358 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 07 08:58:20.263358 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 07 08:58:20.263358 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 07 08:58:20.263358 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cf010ae-3b1c-4424-93a1-909556809cd9 could not be found. Jun 07 08:58:20.263358 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: ERROR nova.api.openstack.wsgi Jun 07 08:58:20.264871 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: DEBUG nova.api.openstack.wsgi [None req-ccc84a16-d191-4bb2-aa47-191a4c974303 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Returning 404 to user: Instance 1cf010ae-3b1c-4424-93a1-909556809cd9 could not be found. {{(pid=129726) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 07 08:58:20.264871 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO nova.api.openstack.requestlog [None req-ccc84a16-d191-4bb2-aa47-191a4c974303 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9" status: 404 len: 111 microversion: 2.1 time: 0.029337 Jun 07 08:58:20.264871 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: [pid: 129726|app: 0|req: 561/1128] 10.222.0.17 () {58 vars in 1235 bytes} [Tue Jun 7 08:58:20 2022] GET /compute/v2.1/servers/1cf010ae-3b1c-4424-93a1-909556809cd9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 07 08:58:21.727514 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: DEBUG nova.api.openstack.wsgi [None req-386c620e-402f-4b02-a77d-b67a59d5da03 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] Calling method '.version_select at 0x7f7fede82790>' {{(pid=129725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 07 08:58:21.838933 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO nova.api.openstack.requestlog [None req-386c620e-402f-4b02-a77d-b67a59d5da03 tempest-TestVolumeBootPattern-227742588 tempest-TestVolumeBootPattern-227742588-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-996397736" status: 202 len: 0 microversion: 2.1 time: 0.115268 Jun 07 08:58:21.839506 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: [pid: 129725|app: 0|req: 568/1129] 10.222.0.17 () {58 vars in 1259 bytes} [Tue Jun 7 08:58:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-996397736 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 07 08:59:54.403584 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 08:59:54.404374 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Tue Jun 7 08:59:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 09:00:05.644561 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 09:00:05.645220 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Tue Jun 7 09:00:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 09:01:35.544788 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 09:01:35.545454 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Tue Jun 7 09:01:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 09:01:43.827547 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 09:01:43.828126 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Tue Jun 7 09:01:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 09:03:14.412945 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 09:03:14.413460 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Tue Jun 7 09:03:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 09:03:25.652814 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 09:03:25.653450 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Tue Jun 7 09:03:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 09:03:31.219434 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 09:03:31.220518 dv-cinder-740146-15-iscsi devstack@n-api.service[129726]: Tue Jun 7 09:03:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 07 09:03:35.772078 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 07 09:03:35.772638 dv-cinder-740146-15-iscsi devstack@n-api.service[129725]: Tue Jun 7 09:03:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!